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Tm,r, of tftk tnvtsntton 

Apparatus of Universal Multimedia Framework and Terminal with Content 
Adaptation 

CLAIMS 

(1) Apparatus of Universal Multimedia Framework Terminal with 
Content Adaptation, comprising the following steps o£ 

Building a terminal with content decoding tools that is compliant to 
certain standard; 

Describing the said terminal using DIA (Digital Item Adaptation) 
Descriptions; 

Attaching the said DIA Descriptions to the said terminal; 

Sending and submitting the said DIA Descriptions to a server for 
retrieving a piece of content; where 

The said server is parsing and processing the said DIA Descriptions; 

and 

Selecting the content which is in the matched format with the said 
DIA Description submitted by the said terminal; and 
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Delivering the said content to the said terminal. 

(2) Apparatus of Universal Multimedia Framework Terminal with 
Content Adaptation, comprising the following steps of: 

■ * 

Building a terminal with content coding tools that is compliant to 
certain standard; 

Describing the said terminal using DIA (Digital Item Adaptation) 
Descriptions; 

Attaching the said DIA Descriptions to the said terminal; 

» 

Implementing a DIA Description Generator in the said terminal to be 
able to generate DIA Descriptions on-line; 

Generating DIA Descriptions on-line to describe network condition 
and user preference based on network protocol, other tools, or user preference 
in the said terminal; 

■ 

Sending and submitting the said DIA Descriptions to a server for retrieving a 
piece of content; where 

The said server is parsing and processing the said DIA Descriptions; 

and 
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■ 

Selecting the content which is in the matched format with the said 
DIA Description submitted by the said terminal; and 

Delivering the said content to the said terminal. 

(3) Apparatus of Universal Multimedia Framework Te rminal with 
Content Adaptation, comprising the following steps of: 

Building a terminal with content coding tools that is compliant to 
certain standard; 

* 

Describing the said terminal using DIA (Digital Item Adaptation) 
Descriptions; 

Attaching the said DIA Descriptions to the said terminal; 

Implementing a DIA Description Generator in the said terminal to be 
able to generate DIA Descriptions on-line; 

Generating DIA Descriptions on-line to describe network condition 
and user preference based on network protocol, other tools, or user preference 
in the said terminal; 

Implementing a DID (Digital Item Declaration) Parser; IPMP 
(Intellectual Property Management and Protection) Parser, EEL (Rights 
Expression Language) Parser, HDD (Rights Data Dictionary) Parser, and DIA 
Parser in the said terminal to be able to parse DID, IPMP, REL, RDD, and 

3 
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DIA descriptions 

Browsing a DI (digital Item) with its DID, IPMP, REL, RDD, and DIA 
Description; 

♦ 

Selecting "choice" notes in DID menu by the said terminal; 

■ 

Parsing IPMP, REL, RDD, and DIA descriptions in DID menu in the said 
terminal if there is such description appearing in the said DID menu; 



Submitting the said DIA Descriptions used to describe the said terminal, the 
said network condition, and the said user preference to a server for retrieving 
a piece of content when there is such DIA note met in the said DID menu; 
where 

The said server is parsing and processing the said DIA Descriptions; and 

Selecting the content which is in the matched format with the said 
DIA Description submitted by the said terminal; and 

Delivering the said content to the said terminal. 

(4) Apparatus of Universal Multimedia Framework Gateway with 
Content Adaptation, comprising the following steps of: 

Building an adaptation gateway with transcoding function; 
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Building an adaptation gateway with a DIA Parser; 

Describing terminal using DIA (Digital Item Adaptation) Descriptions, 
attached to the said terminal; 

♦ 

Registering the said DIA Descriptions into the said adaptation 
gateway for each, of the said terminal supposed to be supported by the said 
adaptation gateway; 

Receiving content with its DIA descriptions in the said adaptation 
gateway; 

Parsing the said received DIA descriptions used to describe the said 
content by the said DIA Parser in the said adaptation gateway; 

Comparing the said and parsed DIA descriptions used to describe for 
the said content with the said DIA descriptions used to describe fox the said 
terminal; 

Transcoding the said content if there is mismatched in term of coding 
formats indicated by the said comparing results mentioned in the above step; 

Generating a new set of DIA descriptions to describe the content in 
the said transcoded coding format done in the above step; 

Attaching the said new set of DIA descriptions to the said content in 
the said transcoded coding format; 
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Sending the said contents with different transcoded coding formate by 
the said adaptation gateway to the said supported terminal. 

(5) Apparatus of Universal Multimedia Framework Server with Content 
Adaptation, comprising the following steps o£ 

Building a multimedia server with stored multimedia contents; 

Creating DIA descriptions for each said content; 

Attaching the said DIA descriptions to the said corresponding content; 

Implementing a DIA Parser in the said server; 

Implementing or plugging-in adaptation tools in the said server to be 
able to perform transcoding, functions between different multimedia formats; 

Receiving a set of DIA descriptions from a terminal via any means, 
where the said set of DIA descriptions used to describe for the said terminal 
decoding capability, network condition used, as well as user preference; 

Parsing the said set of DIA descriptions by the said server; 

Selecting the said adaptation tools to perform transcoding to convert 
from one format to another in the said server, according to the said parsing 
results mentioned in the above step; 
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Generating a new set of DIA descriptions to describe the said 
transcoded content; 

Attaching the said new set of DIA descriptions to the said transcoded 
content as its metadata; 

4 

Delivering the said content with the matched coding format, network 
condition, and user preference to the said terminal. 

(6) Apparatus of Universal Multimedia Framework Server with Content 
Adaptation, comprising the following steps of: 

Building a multimedia server with stored multimedia contents; 

Creating DIA descriptions for each said content; 

Attaching the said DIA descriptions to the said corresponding content; 

Implementing a DIA Parser in the said server; 

Implementing or plugging-in adaptation tools in the said server to be 
able to perform transcoding functions between different multimedia formats; 

Pre*transcoding and storing the said content in the said server to 
several popular coding formats using the above said adaptation tools; 

7 
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Receiving a set of DIA descriptions from a terminal via any means, 
where the said set of DIA descriptions used to describe for the said terminal 
decoding capability, network condition used, as well as user preference; 

Parsing the said set of DIA descriptions by the said server; 

Selecting the said stored content in the said server, which is in the 
required format that is described by the said DIA Descriptions submitted by 
the said terminal; 

Generating a new set of DIA descriptions to describe the said 
transcoded content; 

Attaching the said new set of DIA descriptions to the said transcoded 
content as its metadata; 

Delivering the said content with the matched coding format, network 
condition, and user preference to the said terminal. 

(7) Apparatus of Universal Multimedia Framework Server with Content 
Adaptation, comprising the following steps of: 

Building a multimedia server with stored multimedia contents; 

■ 

Creating DIA descriptions for each said content; 

Attaching the said DIA descriptions to the said corresponding content; 
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Implementing a DIA Parser in the said server; 

Implementing or plugging-in adaptation tools in the said server to be 
able to perforin transcoding functions between different multimedia formats; 

Providing IPMP, REL, HDD, and DIA descriptions in DID menu for 
user to view and select; 

Making choices from the said DID menu by the said user who is using 
a terminal; 

Receiving a set of DIA descriptions from the said terminal during the 
said choice making, where the said set of DIA descriptions used to describe 
the said terminal decoding capability; 

Receiving a set of DIA descriptions from the said terminal during the 
said choice making, where the said set of DIA descriptions used to describe 
the network condition and user preference; 

Parsing the above said set of DIA descriptions by the said server; 

Selecting the said adaptation tools to perform transcoding to convert 
from one format to another in the said server, according to the said parsing 
results mentioned in the above step; 

Generating a new set of DIA descriptions to describe the said 

9 
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transcoded content; 

Attaching the said new set of DIA descriptions to die said transcoded 
content as its metadata; 

Delivering the said content with the matched coding format, network 
condition, and user preference to the said terminal. 

(8) Apparatus of Universal Multimedia Framework Server with Content 
Adaptation, comprising the following steps of 

Building a multimedia server with stored multimedia contents; 

Creating DIA descriptions for each said content; 

Attaching the said DIA descriptions to the said corresponding content; 

Implementing a DIA Parser in the said server; 

Implementing or plugging-in adaptation tools in the said server to be 
able to perform transcoding functions between different multimedia formats; 

Pre-transcoding and staring the said content in the said server to 
several popular coding formats using the above said adaptation tools; 

Providing IPMP, REL, RDD, and DIA descriptions in DID menu for 
user to view and select; 
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Making choices from the said DID menu by the said user who is using 
a terminal; 

Receiving a set of DIA descriptions from the said terminal during the 
said choice making, where the said set of DIA descriptions used to describe 
the said terminal decoding capability; 

Receiving a set of DIA descriptions from the said terminal during the 
said choice making, where the said set of DIA descriptions used to describe 
the network condition and user preference; 

Parsing the above said set of DIA descriptions by the said server; 

Selecting the said stored content in the said server, which is in the 
required format that is described by the said DIA Descriptions submitted by 
the said terminal; 

Generating a new set of DIA descriptions to describe the said 
transcoded content; 

Attaching the said new set of DIA descriptions to the said transcoded 
content as its metadata; 

Delivering the said content with the matched coding format, network 
condition, and user preference to the said terminal. 

11 



1 1 2003-3041534 



#2 00 2-127160 



(9) Apparatus of Universal Multimedia Framework Terminal with. 
Content Adaptation, where Describing the said terminal using DIA (Digital 
Item Adaptation) Descriptions in claim (1), (2), and (3), further comprising the 
fallowing steps ot 

Describing the said terminal by using a hierarchy structure, including 
terminal general feature, terminal hardware, terminal software, terminal 
system, and terminal decoding capability as the 1st layer; 

Describing the said terminal decoding capability in different coding 
layers, from primary content, source decoding layer, system decoding layer, 
transmission layer, to the said DIA descriptions; 

Defining detail descriptions in each coding layer including coding and 
decoding parameters, to indicate the maximum supporting ranges by the said 
terminal for different parameters used in the said decoding process; 

Defining controlling terms to use in the said DIA descriptions 
mentioned in the above, which is a set of common terms and used to signal 
between the said terminal and the said server. 

(10) Apparatus of Universal Multimedia Framework Terminal with 
Content Adaptation, where Describing the said terminal using DIA (Digital 
Item Adaptation) Descriptions in claim (1), (2), and (3), further comprising the 
following steps of 

Describing the said terminal by using a hierarchy structure, including 
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terminal general feature, terminal hardware, terminal software, terminal 
system, and terminal decoding capability as the 1st layer; 

Describing the said terminal decoding capability in different coding 
layers, from primary content, source decoding layer, system decoding layer, 
transmission layer, to the said DIA descriptions; 

Defining detail descriptions in each coding layer including coding and 
decoding parameters, to indicate the maximum supporting ranges by the said 
terminal for different parameters used in the said decoding process; 

Defining controlling terms to use in the said DIA descriptions 
mentioned in the above, which is a set of common terms and used to signal 
between the said terminal and the said server; 

Expressing the said DIA descriptions in XML to provide extensibility. 

(11) Apparatus of Universal Multimedia Framework Terminal with 
Content Adaptation, where Describing the said terminal using DIA (Digital 
Item Adaptation) Descriptions in claim (1), (2), and (3) further comprising the 
following steps o£ 

Describing the said terminal by using a hierarchy structure, including 
terminal general feature, terminal hardware, terminal software, terminal 
system, and terminal decoding capability as the 1st layer; 

Describing the said terminal decoding capability in different coding 

13 



13 



ffiSE#2 003-30415 3. 4 



#2002-127160 

layers, from primary content, source decoding layer, system decoding layer, 
transmission layer, to die said DIA descriptions; 

Defining detail descriptions in each coding layer including coding and 
decoding parameters, to indicate the maximum supporting ranges by the said 
terminal for different parameters used in the said decoding process; 

Defining controlling terms to use in the said DIA descriptions 
mentioned in the above, which is a set of common terms and used to signal 
between the said terminal and the said server; 

Creating the said DIA descriptions in the form of SDL (Syntactic 
Description Language). 

(12) Apparatus of Universal Multimedia Framework Terminal with 
Content Adaptation, where Implementing a DIA Description Generator in the 
said terminal to be able to generate DIA Descriptions on-line in claim (2) and 
(3), where 

> 

network condition that is related to content format adaptation is 
described by defining controlling terms, like bandwidth, delay, and packet 
loss; and 

* 

user preference that is related to content format adaptation is 
described by defining controlling terms, like quality, color, size, streaming, 
downloading, filtering with their attributes; further comprising the following 
steps of: 

14 
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* » 

Receiving network condition in the said terminal from network 
protocol, other private tools, or user input; 

Converting the received parameters on network condition in the said 
terminal into the said DIA descriptions by using the said controlling terms 
defined in the above steps; 

Receiving user preference in the said terminal from User Interface; 

Converting the received parameters on user preference in the said 
terminal into the said DIA descriptions by using the said controlling terms 
defined in the above steps. 

ny.TATT.im n rcsfimprroN of the tnvrntton 

HELD ™? THF TNVENTTON 

The present invention relates to a unified multimedia terminal that can 
access multimedia content in different formats, and relates to a unified 
multimedia framework that can handle different multimedia terminal, 

* 

network, usage environment. 
BAfiyttROITNT) OF THE INVENTION 

MPEG and other standard bodies have created many standards in video, 
audio, system, communication protocol, content representation, content 
packaging, etc., to ease for content transfer and deliver from one place to 
another in an efficient way, as well as content storage with big volume in a 
limited space. 

16 
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As a result of it existing contents can be found in different formats due to the 
different source coding methods, MPEGl, MPEG2, MPEG4, DV, DVCPRO, etc, 
and at the same time devices and terminals are also built in different scope to 
be compliant with certain standard but not with another. For example, a DTV 
STB (Set-Tbp-Box) can decode and play back MPEG-2 compliant content but 
cannot play back DV content, or MPEG-4 content. 

It would be desirable that there has a universal multimedia terminal, which 
can access and consume any content no matter what format it is. There are a 
few ways to achieve this. 

One way is to build a terminal that has a powerful transcoder function to 
understand all the different formats and decode them in real-time, then 
encode the content into the required format in real-time. But the cost would 
be very high for having such a real-time multifunctional transcoder. It is 
definitely not advisable to use for portable terminal, even for DTV, or DVD 
like devices. 

Another way is to have such transcoder function in service provider side / 
content creation side, or in a gateway site, to pre-transcode and store the 
same content in different formats. 

In such case a set of descriptions or metadata to describe content 
representation format can be created and attached to the corresponding 
content. By matching a query submitted by a terminal with the stored 
metadata in a server, the server will decide which content in the specific 
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format will be delivered to the terminal Here the terminal has to be a 
compliant terminal, to be able to generate a set of pre-defined descriptions or 
metadata that the server can recognise. 

Besides the set of descriptions to address content representation format, a set 
of descriptions to describe terminal, as well as set of descriptions to describe 
other usage environment including network condition and user preference, is 
also required to define. However usage environment is different from content 
representation format and terminal, and it is changeable and selectable and 
not fixed with the terminal Kke terminal decoding capability. . . 

Here this invention is focusing on defining a set of descriptions and the 
structure among the descriptions, as well as to define a mechanism for a 
multimedia framework used across different terminals and network. 

PROBLEMS TO BE SOLVED 

This invention is to try to solve the following problems: 
' The same content or media resource in certain format can be accessed, 



retrieved, and consumed by any multimedia terminal with different network 
condition and different user preference. 

A terminal with different decoding capability and network condition is able to 
access, retrieve, and consume any content or media resource that is in 
different data formats. 



MEANS FOR SOLVING r , 



7, PROBLEMS 
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The present invention is related to Digital Item Adaptation (DIA), especially 
content format adaptation, as well as network adaptation and user preference 
adaptation according: to their DIA descriptions. 

■ 

DIA descriptions are defined to describe content representation format and 
ter min al decoding capability, and network condition and user preference. DIA 
descriptions are divided into two categories: fixed and changeable with a 
given terminal Content Representation Format Descriptions that is 
corresponding to Terminal Decoding Capability, is unlikely to change to a 
given ter minal, and Descriptions on network condition and user preference 
could be changed as terminal used in different network and used by different 
users. 

A hierarchy description structure is presented with the corresponding 
controlled terms to provide a full set of DIA Descriptions on Content 
Representation Format that is used in describing terminal decoding 
capability together with other terminal characteristics. A mechanism is 
introduced to use such DIA descriptions in both one-way and two-way 
applications where both terminal and server are implemented with DIA 
Descriptions Generation and DIA Parser so that they can understand each 
other to adapt to the terminal capability. 

On top of the DIA Descriptions on terminal decoding capability and other 
terminal characteristics, another type of DIA Descriptions is also defined to 
reflect Network Condition and User Preference that will affect content 
adaptation; A mechanism is introduced to use such DIA Descriptions in real- 
time streaming content delivery applications where both terminal and server 
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are implemented with such DIA Descriptions Generation and DIA Parser ' 

By defining a set of descriptions for content representation format, a piece of- 
content or media resource can be described to reflect its coding format and 
style, where the set of descriptions can be defined based on coding condition 
according to certain coding standard, and also based on parameters extracted 
from the bit stream headers. 

By defining a set of descriptions for a terminal, the terminal can be described 
to reflect its conformed decoding capability. 

By defining a set of descriptions for a terminal, the terminal can be described 
to reflect its processing power, memory, operating system, etc Such 
description is sent to a server from the terminal before the server can deliver 
content in the right coding format. 

By defining a set of descriptions for network, the network condition which a 
terminal is connected to, can be described to reflect communication protocol, 
average bandwidth, delay status, packet loss status, etc. 

By defining a set of descriptions for user preference, user's interest and 
preference can be described to reflect user's choice and selection. 

By defining the hierarchy and structure of the above descriptions, a 
multimedia framework can be built for content delivery to any terminal via 
any network. 

19 
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* 

„ b. M u, fo=» . — * ——f ** ° a? " aVe 

decoding capability. 

By defining a ^ used for construct a multimedia — 
w rf the existing and future applications can be served for .ore users who 
have different terminals and different network. 

n? m gpQH m> THE TNVFiNTTON - 
On the terminal side: 

« AMPEQ-21 Terminal is built by implementing one of the source coding 
tools like MPEG-4 Video decoder for simple profile; 

2) AMPEG-2 1 Terminal is built by implement^ one of the system codmg 

tools like MP4 file format; 

3) AMPEG-Zll^alisbuutbyimplementingoneof^eTran^ 

tools like RTP; 

4) A MPEG-2 1 Terminal is built by implementing MPEG-2 1 DID (D^tal 
Item Declaration). EEL (Bights Expression Language), RDD (Rights 
Data Description). IPMP (Intellectual Property Management and 
Protection), and D1A (Digital Item Adaptation) Parser; 

6) A MPEG-21 Terminal is built by setting-up a table to descnbe the 
term inaVs characteristics such as compliant decoding format including 
source coding format, system layer coding format, transmission format, 
wbere the table can be expressed in XML schema or in SDL (Syntactic 
Description Language) syntax, where more detail descriptions will be 
included in each t*pe of coding format, such as bit rate, display window 
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size, buffer size, etc. 

On the content server side: 

1) A content or media resource that is in certain data format is pre* 
tran seeded into different data formats with its defined metadata or a 
set of defined DIA descriptions to describe each type of formats 



according to MPEG-21 DIA defined structure. 

2) MPEG-21 Digital Item (DI) is generated by constructing a scene 
structure where the corresponding DID/IPMP/REMIDD/DIA 
descriptions are structurally linked together to tell you what is the 
digital item and where is the media resource, how it is protected, what 
are the rights for using the DI, and what is the possible terminal and 
network adaptation listed in form of "choice" for the media resource in 
order to be delivered and consumed by users. This is used for two-way 
interactive application. 

3) For one-way application like broadcasting, MPEG-21 Digital Item will 
be created according to the specific terminal and network condition 
received from terrain aL 



DETAILED BESCBIE11QM w the preferred embodiment 



The prior art is illustrated in Figure 1 and Figure 2 to state the current 
situation where a content in certain data format cannot be played back by 
different terminals. 

In Figure 1, it is shown that MPEG-2 MP@ML content is delivered horn 
Multimedia server in module 1.1 to user in one-way, and only DTV STB in 
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module 1.4 can play back. The other terminals in module 1.2, 13, and 1.5 
cannot play the content 

In Figure 2, it is shown that MPEG-2 MB3ML content is delivered from 
Multimedia server in module 2.1 to user in interactive two-way, and only DTV 
STB in module 2.4 can play back. The other terminals in module 22, 2.3, and 
2.5 cannot play the content. 

From the above examples it is understood that such situation limits the 
content accessibility by a broad range of terminals and network 

On the other hand, it is not possible for terminal to be built to enable decoding 
all different formats of content, which is too much costly. 

The following embodiments are arranged in the two major sections: 

Hierarchy DIA Descriptions for adaptation to different terminals used in 
Interactive Two-way or One-way applications and real time streaming 
adaptation to different network; 



Interactive Two-way application case 

The interactive application is very popular in existing world, such as DTV 
Interactive data broadcasting, Internet based services, Interactive DVD, 
Interactive data access by Mobile phone, etc. 

22 
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Typical model for this two-way application is that server provides a layer 
structured mean to be viewed by User, User selects what he want to retrieve 
by sending request to server from a client terminal, and the server processes 
the request and delivers the requested content to the client terminal. 

Here the content is referred to media resource in MPEG-2 L 

As shown in Figure 3, MPEG-21 Multimedia Server is illustrated in module 
3.1 where content or media resource is stored attached with a set of DIA 
descriptions. 

* 

In module 3.11 a MPEG-21 terminal is shown and it consists of source coding 
tool in module 3.10, system layer coding tool in module 3.9, transmission 
protocol in module 3.8, as well as MPEG-21 DIA parser and a set of DIA 
descriptions in module 3.7. The terminal is connected to TCP/IP, UDP, ATM, 
or other network in module 3.6. 

The case what we are talking here is corresponding to Case 2: Two-way 
Interactive Application shown in Figure 3. First of all, the terminal or user 
will browse a Digital Item, parse the DID/EPMP/REL/RDD and DIA 
descriptions based on what a user selects in module 3.5. The server delivers 
the content with matched data format to the terminal according to the choices 
made by the terminal, in module 3 A 

In the above interactive process, the information received by the server 

consists of two types: User involved and Non-user involved, 

1) User involved information: those requests or choices made by the user 
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during the browsing, such as user preference; 

2) Non-user involved information: the terminal characteristics sent from the 
terminal automatically when the DIA descriptions are parsed iirnragh the 
DIA Parser in the terminal. 

One-way Broadcasting Application Case 

In this way, terminal is not supposed to communicate with the server 
interactively like two-way application. 

As shown in Figure 3 for Case 1: one-way Application, the terminal needs to 
initiate the content delivery by sending a request with a set of DIA 
descriptions, to tell the server Vhat I am" and "what I can do" in module 3.2. 
The server processes the request and the set of DIA descriptions to transmit 
the content with the matched format to the terminal, in module 3.3. 

There are two types of DIA descriptions. One type is related to terminal 
characteristics, such as terminal complaint decoding format, terminal process 
power, etc., and this type of the descriptions is fixed with the terminal and not 
likely be selected by User; while the other type is related to network condition 
and user preference which is not fixed with the terminal and it is changeable 
with different network condition and different user preference. 

No matter one-way or two-way applications, those DIA descriptions related to 
terminal characteristics have to send to the server by terminal not by user. 
For one-way application they can be submitted to server during 
communication starting period, while for two-way application they can be 
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submitted to server in the beginning or in the middle way of interactive 
communication. While those DIA descriptions related to network condition 
and user preference can be given by user or network protocol that is used in 
the communication during the delivering process. 

Hierarchy Description for Each Coding Layer: 

As shown in Figure 4, a general media resource in module 4.1 can be in the 
form of text, graphics, still image, audio, video, which are considered as 
source coding format in module 4.2. 

If there is combination of audio and video, system coding is required as shown 
in module 4.3 to synchronize audio and video, such as MPEG-2 Transport 
system and Program system which are widely used in the products. 

In some case a transmission protocol is required as shown in module 4.4, to 
achieve certain transmission purpose, such as real time transmission. 

Such a media resource is formed using various types of coding format, and a 
set of descriptions is generated to tell the coding structure of the media 
resource, as shown in module 4.5, called MPEG-2 1 DIA Description. 

Such descriptions and the layer structure among different layers can be 
expressed in XML or in MPEG-2 1 file format in the form of SDL (Syntactic 
Description Language). Here a XML based schema is used to describe such 
DIA description as one of the possible solutions (the structure of schema is 
shown in Figures 5A and 5B and the detail schema can be found in the end of 
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this section). 



we define an exhaustive terminal 
^enin^-Genexal *— descnp.on of terminal 

coding capability can be seen ux Codingo 

in general terminal descrmhon. the term** Mobae phone etc 

^ as encode, decode, gateway, router. PC, 



axe described. 



te nre tw0 important elements to 



these two parts are listedbelow 



, ..CPUeg IntelPentiumini-lSGH^ 
CPU '- Vendor, Model, Speed, of the device CPU, lntelSDRAM PCl33 

xr i Model Size of the device memory, e.g. m 
Memory: Vendor, Mooei. oi* 

128M; e g Yamaha YMF 7 5 3; 

Speaker : Vendor, Type of the device spe ^ Ergoll omic 

keyboard: Vendor. Type of the device keyboard. e.g. 
Keyboard; 

dM »*». «««•» . Bia ,„ KMj r :a ,.»™i««t« M 
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.a of eray the device can display in screen; 
colours or shades of gray 

« i the type of resolution of the pounds 

"PointingBesolutaon . «ne vyt> 

Hardware ^ --^ ^ 

A^aWware: soma aa«a»t Hard™. »PP«<». 
OS: Venter. Name, Varaon. S™™" 
VM: Vendor, Name, Version ofthevurtu 

SunJREl-2; which ^ device's low- 

, Taioawio Version of the firmware to wlncn we 
Firmware: Vendor, Name, Version 

level software conforms; tenninal supports "Software 

Software Support indicate whether the 
download-, -Browser" with its name and versum; 

, W of terminal system including processing "Modules'. e.g. 
G^eral desc^taon m terminal sy performing. 

- i tnnte for scone special. 
extra ternunal tools -Configuration- optaon. 

For MPEG-21 multunedxa fiameworlc. .esiding 
should be provided. The IPMP system descrip* 
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EPMPJIbols with their TbolID and the support of RDD/REL. 

The terminal coding capability is described in a structured mode according to 
content type (Audio, Video, Image/Graphic, Text) and the respective coding 
type (e.g. MPEG. ITU). la each coding type, profiles and levels are used.for 
further classifying and extending. Besides these coding formats description, 
the coding parameters f ControHerms") such as Picture Size, Display Widow 
Size, Bit Rate, Frame Rate, Buffer Size, etc are the possible control items to 
use to describe coding format The details can be found in the following video 
coding structuring explanation and the terminal schema description. 

The detail structuring for video is also shown as in Figure 4 to illustrate what 
are the possible items or parameters required to describe video. 

As for MPEG-n video coding format, there are MPEGl video, MPEG2 video, 
MPEG4 video, and also MPEG4 AVC (Advance Video Coding). Under each 
MPEG video coding format, there is profile, level, version to tell the compliant 
level. 

So for a given media resource, what profile, what level, and what version has 
to be given to just describe its video coding format. It is shown as in module 
4.6, 4.7, and 4.8 in Figure 4, respectively, where Simple profile with Level 1 
and Version 1 is indicated for the video coding. 

On top of that, coding parameters are also required to be included in 1he DIA 
video coding descriptions, which is shown in module 4.9, where Picture Size: 
W/H (Width and Height), Display Widow Size; W/H, Bit Rate, Frame Rate, 
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video coding format 

Here video can include primary video in different video formats, like CCIR601 
42:2, RGB with 8 bits for each colour component, etc. 

'Video format also covers DVxxx that includes DV (Digital Video) format used 
in DV camera, DVCPRO-25, DVCPRO-5G, DVCPRO-HD. These are the 
popular format found in the original content and captured by digital camera. 

H_26x consists of H.261 and H.263, and mainly used in videoconference 
products; 

M-JPEG is motion JPEG; 

WMV is Window Media Video used widely in PC world; 

Real Video is another type of video format used in the product of Real 

Network; 

In the same way as video, Audio and speech also need to cover different 
formats: MPEG-n audio like MPEG Layer 2, MP3, MPEG2-AAC, MPEG4- 
AAC, and G series like G. 72 1/2, G.723, G.726, G.729, etc Image and graphics 
covers various types of formats, like JPEG, JPEG-2000, GIF, TIFF, XBM, 
PICT, etc 

DIA description to describe a content structure and a terminal is shown in 
Figure 6, 

In module 6.1, DIA descriptions are listed to describe a media resource, while 



29 



2 9 



ffi!E# 2003-304 1534 



#2 002—127160 

m * 

in module 6.2, DIA descriptions are listed to describe a multimedia terminal. 



Li the front of a content structure, a set of DIA descriptions is always 
attached by described the detail coding structure of the content, as shown in 
module 6.3. 

On the other hand, for a given terminal a set of DIA descriptions is always 
requested to be implemented with the terminal to describe the terminal 
decoding capability and its processing power, as shown in 6.4. 

From Figure 6, it is dear that two formats in module 6.1 and 6.2 do not match 
and adaptation is required to enable the same content for the media resource 
can be consumed by the terminal. 

The ideal adaptation is to rely on a real-time Adaptation Gateway that 
contains transcoding module. Once the adaptation gateway receives such DIA 
descriptions as listed in module 6.1, it will convert or transcode the coding 
format to fit for the DIA description as listed in module 6.2 for consuming 
terminal. In this case, for Source Coding Layer, MPEG-2 AAC is transcoded 
into MPEG-4 AAC, and MPEG-2 video MTOML (Main Profile and Main 
Level) transcoded into MPEG-4 video Simple Profile with Level 1 and Version 
L For System Coding Layer, MPEG-2 Transport System is converted and 
transcoded into MP4 file format. A downsize process is required here before 
encoding into MPEG-4 Video format from MPEG-2 video due to the different 
supported Picture Sizes on two sides indicated in Coding Parameters in the 
two sets of DIA descriptions. 
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The adaptation gateway is shown in Figure 7 to illustrate the above solution. 
It consists of DIA Parser and transcoding module to convert from one format 
into another and re-deliver to a terminal. 

As shown in Figure 7, in module 7.1 DIA Parser in an Adaptation Gateway is 
to process the input DIA descriptions received from a server, and in module 
7.2 the processed results after module 7. 1 are compared to the Terminal's DIA 
descriptions mat are subscribed by the terminal. Based on the results in 
module 7.2, transcoding in Source Coding layer and System Coding layer will 
be performed in module 7.3, 7.4 and 7.5, respectively for audio, video, and 
system coding format. 

Sometimes to save computation time, the conversion or transcoding can be 
done in bit stream level, and such intelligent trancoding tool can be even 
implemented in a terminal and the implementation can be different in 
different situations. These will be left to implementers to consider according 
to their terminal's process power and applications. 

There is another better way to serve for the purpose. The useful working 
model should be relying on the processing power on server side. More 
important point is the application scenario where a media resource is pre- 
encoded and stored in a multimedia server or library. In such case, the same 
content can be pre-transcoded and stored in different coding formats to match 
with the popular and widely used cases. 

A generic block diagram is shown in Figure 8 for one of the implementations, 
A MPBG-21 terminal in module 8.1 with its DIA Descriptions is sending a 
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In Figure 10, a real-time adaptation framework is shown to illustrate the 
streaming case where network condition and user preference is fed back to. a 
server all the time so that the server uses such information to determine what 
kind of media resource should be delivered to a terminal to match with the 
suitable bit rate. 

As shown in Figure 10, a MPEG-21 multimedia server is shown in module 
10.1 where DIA Parser, Adaptation Tools, and Media Resources are included. 
A MPEG-2 1 terminal is shown in module 10.2 with DIA Description 
Generator in module 10.5 to generate DIA descriptions according to the 
Network Condition in module 10.3 and User Preference in module 10.4. 

In module 10.6 a set of descriptions is listed as an example to illustrate what 
are the possible items needed to submit to the server. 

■ 

A DIA Parser in module 10.7 in the server is to process the received DIA 
descriptions from the client terminal so as to decide to select the appropriate 
adaptation tool from the Adaptation Tbol plug-in in module 10.8. Media 
Resource in module 10.9 is converted by adaptation tool, to adapt to the 
requested and suitable network condition and user preference that is 
described by DIA description. Finally the requested media resource is 
delivered from the server to the client terminal. 

A generic adaptation framework: is shown in Figure 11 to illustrate how the 
adaptation is performed for a given terminal with limited decoding capability, 
different network condition and user preference. 
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MPEG-21 Multimedia Server is shown in module U.l with. D1A Parser. 
Different adaptation tools are implemented or used as plug-in tool in the 
server side. Contents are stored in the server as media resources to be 
retrieved and delivered to user based on request. 

MPEG-21 Client Terminal is shown in module 11.2, where DIA Descriptions 
to describe its decoding capability and processing power in module 11.6, as 
well as a DIA Description on-line generation module to generate DIA 
description on network condition and user preference in module 11.5 is 
included. 

During the starting of the communication, the terminal will send the set of 
DIA descriptions on Terminal Capability to the server, as shown in the arrow 
of "a", to start the content delivery. 

Network Condition in module 11.3 and User Preference in module 11.4 will 
feed back the actual network condition and user preference to the module 11.5 
to generate DIA descriptions on-line anytime if it is requested. The terminal 
will send the set of DIA descriptions on Network Condition and User 
Preference to the server, as shown in the arrow of *V > . 

User Interface is shown in module 11.10 to obtain User Preference. Network 
Condition can be obtained from Network Protocols, or propriety method in 
module 11.11, and it is also possible to be given by user via User interface. 

As shown in module 11.7, DIA Parser in the server side will process the 
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received DIA descriptions from the terminal and select certain adaptation 
tools form the server or plug-in tools to convert and transcode the requested 
media resource into the matched media resource to match with the terminal 
capability and appropriate networking condition and user preference. 



Adaptation tools are shown in module 11.8 on the server side> and it can also 
be implemented in a middle adaptation gateway as shown in Figure 7. Media 
Resources shown in module 11.9 are stored in the server, and it can be pre- 
transcoded and stored in the server to target on several popular coding 
formats, to avoid real-time transcoding for many users at the same time. 



The detail Terminal Description schema is shown below: 
<?xml verekm^'l.O 0 eacoding=^UTF-8"?> 

<|~ edited with XML Spy v4.3 U (http://wwwjanlspy.com) by Huang Zhongyang 
(Panasonic Singapore Laboratories Pte Ltd) 

<xs:scheraa xInln8:x^bttp://ww.w3.Ol^200lyXMLSchcma , ' 
elementPormDefaulU= ,, <iualifLed rt aTtoT>uteF<jrmDefaultF , ^mqualified ,, > 
<xs;element name^TERMINAL^ 
<xs:amu>tation> 

<xs:docunientation>It give the description of terminal 
capabiliticB</x6:documentation> 
<xs:annotation> 
<xscomplexType> 

<xs: sequence maxOocurs= B unbounded ,, > 
<xa: element name^'General" minOccurs="(F> 
<xsxomplexType> 

<XKsequence maxOccurs =,l unbounded tt > 
<xe:element name- 'Device JVpe w minOccurs^O 

<XB:ai2nple , IVpe> 
<xfl:restriction base="xs:string n > 
<xs:enumeration value- 'Decoder"/> 
<xs:enumeratum value=vEncoder M A> 
<xs:enumera(ion value=^Gateway"> 
<xs:enumeration value= , TRouter , '/> 
<xs:enumeration value- 'Camera 1 ^ 
</xsarestriction> 
</xK9impleType> 
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</xs:element> 

<xaelement name= n Device_Class" minOccurs=^0"> 
<tesimpleType> 
<3ts3estriction base= ,, xs:striiiLg u > 
<xB:enumeration value^PC^ 
<xfl:enumeration value- f PDA"A> 
<xs: enumeration value=*OTB ,, J> 
<xs:enumeration value= n Printer n /> 
<xe:enumeration valuo= M MobilePhone B > 
<x8:enumeratdon value- m f> 
</xf?:restriction> 
</xs:simpleType> 
</xs:element> 

<xsielement name=^endor /t type="x8:string" minOccurs= u 0 f, fc 
<xKAlAment name-'Model" type=^ string" minOccurs=°(y/> 
</xs:sequeiice> 
</x8:coniplex'iype> 
</xaelement> 

<xsxlement name^^Hardware" minOccurB^O^ 
<3CKComplexT^pe> 

<xs;seguence maxOocurfi= w unboimdcd B > 
<xacicmeiit name^CPU" minOccursF^0 ,t > 
<XfltcomplexType> 

<xs:attribute name= n Vendor° type=^s: staring" uee-'optionar7> 
<xs:attaribute name^Moder type= n xs:8tring" use^required' 1 ^ 
<xa:attribute name=°Speed M type^sduteger" use= n required°/> 
</xs:complexType> 
</xs:elemeai> 

<xs;element iiame=^ Memory" miuOccurs= n O n > 
<xs:complcxType> 

<xsattrftmte name-'Veiidtar" type= l, xs:8tring M oee^optional^ 
<xs:attribute name="Moder type-'xfiistring" use- 'required"£> 
<xs:attribute name= M Size w type-'xsantegcr^ u6e= n required t1 /> 
<xs:comp lcxType> 
</xs:element> 

<xs:elemenL name-'Speaker" minOecurs^O^ 
<xs:complexType> 

<xs: attribute name-vendor" type="xsatring" use^optionaT^ 
<x8:attribute name^Type" type-'xs: string" use= ,1 reiiuired a /> 
</x8:complexType> 
</xs:element> 

<x8:elemeut name^Keyboard 0 minOccuis= M O f, > 
<xs: complexType> 

<xs:attribute name="Vendar M type- xsistring" usa="optionarV> 
<xs:attxibute oame= M Type" typB= n xK string" use=''required n /> 
</x8:complexType> 
</xs:element> 
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<xael8nient name-'Sercen 0 minOccrursF^O^ 
<xscxjmpLexType> 

<xk sequence maxOccursr= ll unbounded 0 > 
<xs:eleTneTit name="Sjze*> 
<xs:compLaxTypB> 

<xs: attribute name=°horizoiital B type= n xs:integer n use=^required7> 
<xs; attribute name^vertical" lype^xsrinteger" use="required n /> 
</x8:oomplcxiype> 
<xsrelement> 

<xK8lemeiLt name="SizeChar" minOccurs^^ 
<xR:complexType> 

<xs:allribute name="horizontal D type= fl x&intogcr' t use^equired"^ 
<xs:attribute name=*vertir.ar type-'xaiinteger* use=*tequixed"/> 
</xs:coniplexType> 
</x6:element> 

<xseIemeot name^'BitPerPuEr type^xsanteger" minOccurs= n 0 ,, /> 
<xs:element name^'PouitingReeohition" typc= l1 xs:string" minOccu«?F="0 ,, /> 
</xs:sequeiice> 
</xs: complexType > 
</xs:element> 

<xfitelemeiit iiame= s,t Support n minOccurs^O 1 ^ 
<xs:complexType> 

<xs:seqncace minOocurs= n O" m axOccurs^ l uiibaunded"> 
<xk element name^Coior" jninOtxmrs=^0*> 
<xa:complexTypc> 

<xs:attribute name-'Capability" type^xscboofean 0 u9e=^equired ,, > 
</xsxomplex'IVpe> 
<xs:element> 

<xs:elemeat name^lBAtlnput" minOccurs= ,, 0 n > 
<xB:complexType> 

<xs2tttribute name="Capability n type= M xs.booiean ,, use^required'^ 
</x8:complexType> 
</xs: elements 

<xs:e]ement uame^Imagelnputf 1 m.in0ccar8= ,, 0 ,, > 
<xs:complexiype> 

<xs:attribute name^Capability" lype^'xeiDoolean" use^equired^ 

</x8:complex1VP e> 
</xa:element> 

<xs:element name^Voicelnputf minOccux8^ , 0"> 

<x6:complcxType> 
<xs:attribute name=^ ? Oapabilily ,, type^'xaiboolean" UGe^equired"> 

<fx8:complexType> 
</xs:eleraent> 

<xs;element name="SoftKey" minOccnrs="0 H > 
<x8:complexTyp^ > 

<x*attribute name^'Capability" type-'x^boolean 0 use= M required"/> 
</xe:complex , IVpc> 
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</xfijelement> 

<xs:element name^SoundOutput" minOccixrs= n 0 n > 
<xs;ooniplexType> 

<xs:attribute name^Capa^ility" typ8="x8:boolean" use= ? *rcqxdred n /> 
</xfl:complexTfyp e> 
</xs:element> 
</xs:sequence> 
</xs:compJexType> 
</xs:element> 

<xs: element aame^AsatHardware 0 minOccur8=' , 0"> 
<xs:coinplexType> 

<xs: sequence minOcciUfB== ,, (> B maxOecurs^'unhounded^ 
<x8:element name="SmartCard" minOccurs= ,, 0 ,, > 
<xs:comp)exType> 

<xs:attribute name^Vendor 11 type="xs: string* use^optLunaT7> 
<xs: attribute name^Model 0 type="xs: string" u6e=^required n /> 
</xs:complexType> 
</xs:element> 

<xs:element name="HardKey B minOccurs^O^ 
<xs:complexType> 

<xE:attribnte name^type" type=°xs:string" u6e=^reqnir«f/> 
</x8:complexTypft> 
</xsrelement> 
</xs:sequence> 
</xs:oomplexType > 
</xs:element> 
</xs:s8<ruenc8> 
</3C6:complexlVpe> 
</xs:element> 

<xBie]ement name^'Software" minOcxrars?=' 1 0"> 
<xs:complexType> 

<xs: sequence maxOccurs~"unbounded''> 
<xs:element name="OS" minOccnrB^'O^ 
<xs:compIexType> 

<xB:attxibute name^'Vcndor" type="x8:string" use^optional"^ 
<xs: attribute namc-'Name" type=°xB: staring" use=^required"/> 
<xs:attributo name -'Version" type^afloaf use^equired"^ 
<xs: attribute naJne= ,, SerialNb ,, type= w xs:ncmNegative Integer" use="opuonal n ^> 
</xacomplexType> 
</xsrelement> 

<xs:element name^VM" minOocure^'O 
<xs:coniplexType> 

<xs:attribute name^endor 11 type= ?, xe:string ,t use="reqnired"/> 
<xe:attribute name -'Name" type^xs string" use=^ t required' 1 /> 
*^c8:attribute name-'Version" type-'xs: string" use="reqiiired"/> 
<x8:complexType> 
</xs:element> 
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<xs-jelem.ent name^Firmware" minOccurs^O^ 
<xsrcomplexlVpe> 

<xa:attribute name="Vendox^ Lype='xs:struig >t u6e=^quire(T/> 
<xs:nttrfbute name^Name" type^e: string" use="required n /> 
<XKaUribute nama^Version 0 type^^^tring" uBe=°re quired^ 
</xKcnmplexType> 
</xs:«lBment> 

<xs:element name^Support" niinOccurs= ,, 0 ,, > 
<xs:complexTyp6> 

<xs: sequence nunOccurs^O" maxOccur8=^unbouiided D > 
<xs:element. name=^Download 0 minOccurs^O^ 
<x&comp!exTVpe> 

<xH:attribute name^ Capability" type^xKboolean" use^requLred"/^ 
</xKComplex , IVpe> 
<6cs»lement> 

<xs:element aame^Browser" minOccurs= n {y> 
<XKComplexTypB> 

<xscattributc name=^Name n lype^srslariiig" ufie="reqirired"> 
<xs: attribute name=° Version" type="xs:float" uBe^required^ 
</xB:complexTVpe> 
</xs;elemeat> 
</xs:6equence> 
</x8;complexType> 
</xs:element> 
</xs:sequence> 
</xs:oomplexT^pe> 
</x£element> 

<xGrelement name=*System" minOccar8= w 0 p > 
<xs:oomptexType> 

<xs:sequence maxOccurs^unbounded'^ 
<xsrelemcnt name="Generar minOccws= w 0"> 
<xs:complexType> 
<xs: sequence mi n Occurs- 1 0*> 
<x8»lement name- 'Modules" nunOccurs= i, 0 n > 
<xs:compLex f fype> 

<xjb: attribute name^'ModulelD " typc^xsunsignedlnr us8= l, required ,, /> 
<xs:attribute name^Processing" type^xscboolean* 1 use="required"/> 

<xs:complexTVpe> 
</xsielement> 

<xs:element name- ' Cocopanen ta" minOccuTS="0 p > 
<xsxompiex'iype> 

<xb: attribute name-'ComponeiitID n type="x8:unsiguedlnt" 

use^ e quired'7> 

<xs:attribirte name= n Interconnect 0 type="xs:boolean" use-'required n /> 
</xs: complexType> 
<xs:element> 



<xs:elementname="Cfciifigration" rDinOccurfi="(y'> 
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<xsicomplex r EVpe> 

<xs:attribute name="Optioii u type= n x£boolean D u£e= n required ,1 /> 
<tecomplcx f l^pc> 
</xKelement> 
<tesequence> 
<fos:complexType> 
<xs'jBlamenl> 

<xselement name^IPMP* minOccxir8=^0 M > 
<xscomplexType> 
<xs:sequence minOocurs^O^ 

<xs:eIemont name="KesiclingTbolB p minOccurs=^0" maxOccurs= n unboTinded B > 
<X3:complexT^p9> 

<xs '.attribute aame= n TbolID n type= rt x8rimsignedInt rt A> 

</xs:complexTVpe> 
<^cselemeiit> 

<xs:element name= n RDDREL w minOccurs^'O^ 
<x8:comple)cType> 

<xs:attribute name^Capability" type= tt XB:boolean* uBe= 0 required ,, A> 
</xs: complexiype> 
</xaelemeiit> 
</xe:sequenc8> 
</xEComp]f?xType> 
</xa:element> 
</xs:sequence> 
</xs:complexType> 
</xs:eiement> 

<xs:element name=^CodingGapability" minOccurs= n 0"> 
<xs:complexType> 
<xs: Be queues maxOccvu:s=="uiibounded M > 
<xs:element nanie-'Audio" mmOccurs="(F> 
<xBxomplexType> 
<xa:choice> 

<XB:elemeat namo=°MPEG n > 
<x8:complexTjrpe> 

<xs:eequence maxOccuxs="unbounded ,, > 
<xs:element name^'MPEG-l 11 minOccurs="(r> 
<xs:complexTypB> 
<xs:sequence> 
<xs:element name= n Layer ,, > 
<xa*simpleiype> 
<xs;reBtriction base-'xs: string^ 
<xs:eaumeration value="I"/> 
<xs:eaumeration value="IT7> 
<xs:enumeration value="JH ,, /> 
</xs:restrictioii> 
</x6: simpleType> 
</xa:element> 
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<fe«8eqiiaace> 
</xa;complexType> 
</xKeleraent> 

<xselement name= n MPEG-2° mmOccursF="(y> 
<xs:complexType> 
<xs:choice> 

<XKclcmont name= a LowSamplmgRateLayer , > 
<xsaflmpbTyps> 
<xa restriction base=^^stacing n > 
<xf* enumeration valued ["> 
<x8;enumeration valuo="II ,T > 
<xs:enumerati<ni value= M lir/> 
</xsnrestriction> 
</xs:simpicType> 
</xs:elemeiit> 

<xe:element name=^BackwardCompatibleMCliayer B > 

<xs:BimpleType> 
<xs: res trie lion baBe=^xs:8laring"> 
<xs:enumeration value= B I n /> 
<xs:ennmerfltion vanie^T!"^ 
<xs:enumeration vahie= l, III ,1 /> 
</xs:restrictioii> 
</x8ifdmpleType> 
</xe^>lwment> 
<xa:eleme]it name="AAC°> 

<xa6impleTVpe> 
<x6:restriction base=^xK8tring"> 
<xs .enumeration vahie= 0 LowCompIexity ,, /> 
<xs:ennmeratiQn valne=* , MainProfile'V> 
<xs:enumerationvalue- , SamplingRatBS(ialeablePTofile ,, y> 

<xB:enumeration value= M "/> 
</xs:restriction> 
</xe:simpieType> 
</xs:elemen£> 
</xsxhoice> 
<tacomplex'iype> 
</xficelement> 

<xs:element name^MPEG-4 0 minOccurs="0 1 > 
^tcomplexTypO 
<x&:choice> 

<xs:element name^SyntfieticPrafile f *> 
<xs:simpleType> 
<xs:reBtarictioii baBe=' l xastring ff > 
<xs:enumeration value="Leveir/> 
<x3:emuneration vahie-'Level2"/> 
<xe:enumeration vahxe= u Level3 n /> 
</xs:re8txiction> 



42 



4 2 



ffiE4#2 003-3041534 






#2 002-127160 



<xe:aimploType> 
<teelement> 

<XKelemeat name^peeehProfile , t> 
<xs:simpleTvpe> 
<xsorefitzictii>n base= 0 xs:strmg ,, > 
<xs:enumeratioiivalue= r, Leve]r/> 
<xs:Bnumerution value= w Level2"A> 
< /xaarestxiction> 
</xs:sunpleType> 
</xscelement> 

<xs:element iiamc^ScalableProfile 1 ^ 

<X8^ firm p leTyp b> 

<xs:restrictkm base= M xs:string D > 
<xKenumeratioii value- 'Level l w /> 
Otsenumezation vahie= n L(evel2 n /> 
<xs: enumeration vahie="Level3"/> 
<xstemimeration value -'Leve]4'7> 
</xfi;re8triction> 
<Jxsr.simpWType> 
</xa:elemfint> 

<xs:element name^JVlainProCle^ 
<xs:simple'iype> 
<xe:reetriction baae= f, xfi:string n > 
<vs:enumerafcion vahte^Levell"/^ 
<xs:enumeration value= fl Level2"/!> 
<xs;enumeration vaJue^LevelS"^ 
<xs:enumeration valuA^LeveU"^ 
<^xs:restriction> 
</xB^imple'IVpe> 
</xs:element> 

<xs:elenient name^HighQulityProfile^ 
<xs:simpleType> 
<xs:resUiction base-'xarstring^* 
<xs:enumcration value= n Levell tt /> 
<xa:eni2meratioa value="Level2"/> 
<xs:enumeration value="Level3"/> 
<xtj;enumeration value in Level4 ,, /> 
<xs:cnumeration value="Level5 n /> 
<xs:enumeration value= w Level6"> 
<xs:enumeratioB value- 'Level7"/i> 
<xfi:enumeration valuc-'Level8 w /> 
</xe.T08triction> 
<tes:shnple'iype> 
</x8:el8ment> 

<x6:element name^LowDelayProfile^ 
<xs:fiimplelVpe> 
<xs:restrictian base^xsatriag'^ 
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<xs:eiiujaierdtkm vaftte="Leve] 1'7> 
<xKenmneratioii value="Level2 ,, A> 
<X6:cmuneralaan vahie^Level.V^ 
<xs:enumeratian value="LeveM7> 
<xa-enumeration vahie^LevelS 0 ^ 
<xs:enumeratioa value^LevelS^ 
<xs: enumeration value=^Level7"/> 
<xa:enumeratian valne="Leve!8 , '/> 

: <terestriction> 
<fesimpleType > 

</xa:element> 

<xs:elemeal name="NaturalProfile"> 
<xs:sinipleType> 
<xs:restricTiDn base^aietring^ 
<xs:en\uneration value^ , Levell , V> 
<xaenumeration values^Level2f^> 
<xs:enumeration value="Level3 , 7> 
<xs:enumeratioD value=^LeveU7> 
</xa:restari(Ttinn> 
</xs;8impleType> 
<fx8:element> 

<XB»lement name^^^bilcInternetwortogProfile^ 
<xsrsimpleType> 
<xs:restrictiim base=°xs:sfcfing n > 
<xs:enumeration value ="LeveU7> 
<xs:enumeration value^Level^/^ 
<xs:enumcration value^^evelS"^ 
<x6:exrameratioa valua="Level4"/^ 
<xs: enumeration value-'Lerolfry^ 
<xB:ennmaratk>a value-'Level6 n /> 
<tes:restxicti<m> 
</xstsimpleType> 
</xs:elemeiit> 
<Ax8:choice> 
<tes:complexTVpe> 
</xs:element> 
</xe:sequeBce> 
</x8:complexT^pe> 
</xs:elemant> 

<xs:element name= l, n r U-T"> 
<xs;simple r rype> 
<x&re8triction base ="xs: string n > 
<xsenumeration value="G.728"/> 
<xs:enumeration value=^G.723.1"> 
<xa:eamneration vahie^'G.726' , /> 
<xs:emuneraUon vahxe=^ , G-728 ,, A> 
<xs:enumeration value=^G.729"/> 
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</xsiestricti(m> 
</xs:fiimpleTVpe> 
<teelement> 

<xk element name="OtkerCoding n > 
<xa simpleType> 
<xacrestxiction bas0=^6triBg°> 
<xsenumerati£m value=°AC3"/> 
<xs:enTimerauon valuB=°DTS' 1 /> 
<xsemimcrauoii value^AMR"^ 
<xs:ennmeraticm vaiue= n LPOM M A> 
<^c6:enumeratiQn value= n ATRAO 
<XK!eminieration value^ATRACJ?'^ 
<xs:enmneraticn valuB^ATRAC^y^ 
</xa^reBtrictioa> 
</xs:simpIeType> 
</xa"elem.ent> 
<fos:choice> 
</xs:camplexType> 
</xaelemettt> 

<xs:element name=" Video" minOccuie^O^ 
<xa:eomplexType> 
<xsrchoice> 

<xs:element name="MPEG TT > 
<xs:camplex , IVpfi > 

<xk sequence maxOccurt=*unbcmnded"> 
<xs:eIoment name="MPEO-l" type^xsTboolean" minOccars= M 0 B /> 
<xs:element name=^MFEG-2° minOccurs= ,, 0"> 
<X8:complex'iype> 
<xschoice> 

<xs:element name= ?, SinipleProfile ,, > 
<X6:eunploiypa> 
<xe:restrictbn base="xs:8tring"> 
<xB:eaumeration value= r, MainLevel n /> 
</xffrR8trictdon> 
</xs:simpleType> 
<xe:element> 

<xs:element name=^MainJProfile"> 
<xK6iDipIciype> 
<x9:reBtriction base="xs; string^ 
<xs:enumeration valne="LowLevel' t /> 
<xa:e numeration value^'MainLevel"^ 
<xaenumeratioii valne=?'Highl440Level"> 
<xe:enumeration vahie^'HighLevel"/> 
</xsnrestriction> 
</xfi; himploType> 
</xa*ftlement> 

<xs:element name="SNRScalableProfile"> 
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<xa:simpleType> 
<Xarestxictkm DaBe^sstring^ 
<xk enumeration vahie=°LowLevery> 
<xR!nnumeratiDn valufi=°MainLevel"A> 
</xs:restriction> 
^xfi-^unpleTyp^ 
</xe»lemenfc> 

<xs:element aame= tt SpafciaJScalableProfile w > 
<xaaimpleType> 
<xfirrestriction base^x K staring°> 
<xs:enumeration valu8= n MainLevel"/> 
<xs:enumeration value="High 1440Lever/> 
<xs:enumeration value^IighLeveF'^ 
</xje:reetoictioii> 
</xs:simpleType> 
<fo&:olomcnt> 

<xs:element name^HighProfile^ 
<&«simpleTvpe> 
<xs:restriction base= M xK3tring ,1 > 
<xq enumeration vaIue= 51 MainLevel"/> 
<x£:eaumeratiQn value="Higb 1440Lever> 
<3f8»numeration value^'HighLeveFA* 
</xsiefftriction> 
</xs:sinipleType> 
</xe:element> 

<xs: element name="MuhiviewPrafile°> 

<xe:simpleTyP 8> 
<xs:restrictioa base^xs: string^ 
<m-e. numeration value="MainLever/> 
</xs:restricUon> 
</xs:aimpleType> 
</x8:eLement> 

<xKeIemezxt name= ;M V422Proiile w > 
<x8:simpleType> 
<xB3restriction base ^"xs: string 1 ^ 
<xe»numeration value- MainLevel''^ 
</xsarestriction> 
</xa:5impleiype> 
<fcs:element> . 
</xs:choice> 
</xs:complex'fype> 
</xs:element> 

<xs:element name^MPEGrl" minOccurs^O^ 
<X8:complexTVpe> 
<xKchoice> 

<xs:element name^SimpleFrofile^ 
<5cs:simple , IVpe> 
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<x8:restrictioii base= l1 xaatriiig"> 
<xsienumera1ao2i vaJue=°Leve lO 0 ^ 
<xs:eniiinBra Uga value=^LevBll c, > 
<xsrenumeratioii valuc^Level^fc 
<xs: enumeration vahie=^Level3 ,, /> 
</xKrestricticB> 
</xs^iinpleType> 
</xs:clcmeiit> 

<xselement name= D ScalableProfile°> 
<xs:siirip leTyp 

<%srestriction bafie= a xs:smiig"> 
<xs:enumfiration value=°Level 1 "/> 
<x8:enumeratiOD value^LcvelSf^ 
<ta: restriction 
</xB:eimpl8Type> 
<xs:element> 

<xs:eJement name=*AdvancedSimpleProfile°> 
<xs:sinipleType> 
^^restriction ba£8=°xs: string^ 
<xs:enumeration value^LevelO"^ 
<xs: enumeration value= ,, Levell ,, /> 
<x8:enumeration valu6="Lefvel2 ,, /> 
<xs:enumeration value= ,, T J evel3"/> 
<xs:enumeration vaiue= r, Level4 <1 /> 
<xs:enumeTation value="Level5"/> 
<XB:reetriction> 
</xa:simpleType> 
</xs:element> 

<xs:element name="CorBProfile H > 
<5ts:simpleType> 
<xa:resrtriction ba6e= w x8:string"> 
<xs:enumeration value^'Levell"/* 
<xs:enumeration value= ?, LovGl2' , /> 
</x8*JT08trictioii> 
</xR:RimpleType> 
</xs:element> 

<xs:element name^CoreScalableProfile"> 
<xe:simpleiype> 
<xsrrestrictbn base^sistring^ 
<xsienumeration value-'Level l n /> 
<XB:emmieration valuo^Level^'^ 
<xs:enumeration value=^Level3"/> 
</xs:restriction> 
</xk BimplGType> 
</xs:elemeat> 

<XB:element name="AdvancedCoreProffle ,, > 
<xsisimpleType> 
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<x6:restriction base^x EL£\rmg*> 
<xs:enumeratioa valued Level 1 *7> 
<xKenumeratioa vahie^Levd^^ 
</xsrestrictian> 
</xsaimpleType> 
</xs:element> 

<xs:eJement aame="MainProfile H > 
<x£simpIeType> 
<xs:restriction base= 0 xastafiiig n > 
<X8:enumeration valued LeveJ2"/> 1 

<x8:enumerationvahie=^Lfivel3 ,, /> . 
<xs:enumeration value= n Leve!4 M /> 
</xsarestriction> 
</xssimpleType> 
</x8:element> 

<xs:element name^NbitProfile^ 
<xs:simpleType> 
<xs:re6triction baBe=^xfi:string"> 
<xs:entuneration value="LeveL2 n /> 
</xs:reBtriction> 
</xsrsimp leType> 
<xs:elcmciit> 

<xs:olement oaxne^AdvanceditealTimeSimpleProfilc^ 
<xs:simple'IVpe> 
<xs:restric(joa base= ,t XB:6trrn g"> 
<xa:enumeration valne=^Level l"/> 
<xs;enumeration value^'LovoU?' f> 
<xa:enumeratioii valne=^LevelJ?'/> 
<xs:enumeratioii value = fl LeveL4"/> 
<ftcs:re8triction> 
</xe:simpl0Type> 
</xs:element> 

<xe:element name^AdvancedCodingEfficiencyPrafile^ 
<xs:dmpleT^pe> 
<xB:restrictdon base="xs:stri2ig ,1 > 
<xe:enmneratiaii value-'Levell"^ 
<xB:enumeration value-Xevete"^ 
<xsrenumeratioii value ="Level37> 
<xR:enumeration value= n Level4°A> 
</xB;rBBtrictum> 
<te:sunpleTVpe> 
</xe:elomont> 

<xsrelement name^SimpIeStudioProfile^ 
<xs:aimp]e'IVpe> 
<xsirestr iction bas9="xB:6trLng"> 
<xB:enumerali(m value=^Lcvell n A> 
<xKemuneration value="Level2 M /i> 
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<xs:enumeration valu8=°Level3 0 /> 
<xs:enumeration value= 0 Lovcl4 ,l /> 
</xs:reatrictiDo> 
</xs:simple , iype> 
</xs*.elemBDt> 

<XKelcment name^CoreStudiDProfile^ 
<xs:jdmpleT^pe> 
<xs:restriction base= tt xs-^tring^> 
<xs:8innneration value=°Levelr/> 
<^aramfiratioii valufi^LeveliTV^ 
<xs:emime ration value^LevelS*^ 
<xs:enumeration value^LeveM"/^ 
<ft£fi.Testriction> 

</xs:element> 

<xB:element name= n FGSProfile"> 
<x8:sunpleTVpe> 
<xs:reKt3fiction ba5e= n xs:striiig rt > 
<xs:emimeralion value= M LevelO"/> 
<xs:eniunQratioii valuc^Lcvell^ 
<fcs:emimeration valu e="Level2° A> 
<xs:emuneration value ="Level3°/> 
<xa: enumeration value= n LevBl4 n /> 
<xs:enumoration value="Level5 f 7> 
</xsje8triction> 
</xstsimpleType> 
<fca.element> 

<xs:element name^SijnpleFaceAnimationProfile^ 
<xs:simpleType> 
<xs:restriction base= a XKStriag'*> 
<xs;enumeration value="Levelr/> 
<xe:enumcration value^LevelS^ 
</x8:regtrictaon> 
</xs:simpIeType> 
</x8:eiement> 

<xs: clement name^SimploFB APit>file*> 
<xs:omp!eType> 
<xs;restricUon base= n xs:6tring ,, > 
<^te:enumeration value="Levell"> 
<x8:enumeration value^'Level^^ 
</xs:re etriction> 

</xB:BimpIeType > 
</x8:element> 

<xs:e)ement name="Basii^nimatedl^xtureProftte' , > 
<xe:ainipleType> 
<XB:restriction base- 'xs: string^ 
<xs:onumeration value="Level 1 n f> 
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<xs:Bnumeration value =^Level2"/> 
</xRnrestHcti(m> 
</xs:simpleType> 
<tes:elemeat> 

<xs:element name= B ScalablB r IbxturePnifib"> 

<xs:6impIeType> 
<xs.Testriction base= n xs:sfaring n > 
<xa:enuineration yalue^Levcl l n l> 

<tes: simp leTy pe> 
</x&element> 

<xs:element name^Advaiic8dScalable'IbxttrreProfilB 0 > 
<xe:6fanpleTypo> 
<x5*jrestriction ba£e= n xs:string B > 
<xs:enumerati<m value^Levell 0 ^ 
^^enumeration value=°LeveI2"/> 
<xs:enxaneratioxi value =°Level3 u /> 
<&8:restriction> 
</xs:simplflType> 
^xKelement^ 

<xfl:elemnnt narae=°HyhridProfile ,, > 
<to:simpleType> 
<xsa*eEtriction ba9e= n x9:string*> 
<xs:enumeratLon value^Levell"^ 
<xs:enunieratioii value="Level2"/> 
</xfcrefltnction> 
</xs»impleType> 
</xs:olcment> 
<fttKch<rice> 
</xs:coniplexType> 
</xaelement> 
</xs:6equence> 
</xa:complcxTVpe> 
</xs:element> 

<x8;elemeut aame="ITU_T r, > 
<x8:simpleType> 
<xs;restrictxon baBe="xs:8tjhig n > 
<xs:enumoration value="H26l"/> 
<xs:ennineratLon value= M H263"/> 
</xs:restrictxoQ> 
</xs»mpleTVpe> 
</xs:elemeiifc> 

<xs:element name="M-JPEG'> 
<xs:simpleType> 
<xerestricti<m bafic="xsatring"> 
<xs:en\imeration value="mjp2Profile"/> 
<xB;eniuneration value= ,, mj28Profilc ,, > 
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^enumeration ^^^^ 

^enumeration value- QtucKinn 
</xs:resUicOon>' 

«^xs:choice> 
</xs:complexType> 

^enumeration «£SSf-1> 
^enumeration value^™ 

^xeenumerataon va f^. 
^.enumeration valued /> 

<f xtc idiapVrype> 

<xB:complexType> 

<xs:elenie3it nam.*- f" 1 00 
<xs:BiinpleType> -„_ n> 

^•.enumwate^ vai ^ rJ> 

</xs:reRt- , iction> 
</3cs:siTnpleType> 

<ixs:choice> 
</xs:complexTyp6> 
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<XB:eIemeot name^Display WinSize p mmOccurs=°<r> 
<x£xomplexType> 

<xs:attribttte name="vVidtli n type=^cs.-integer B use^re quired^ 
<xsrattribute name^Heighf type^srinteger" uffi= n required"/> 
<AxsxamplexType> 
</x8:clement?» 

<xs:elenieiit name^PictureSize" minOccurs= ,, CP> 
<xa:compWtyps> 

<xKattrfl>ute name^Wurth" typB^santcger" ufift=^required ,f /> 
<%Kattrlbute name^Heightf type="xs:integer" use^required"^ 
</x8:complexType> 
</xB:elemeBt> 

<xs:elemcnt name="Bitxate n type= a x£rinteger" minOccars="0 ,, /> 
<xs:elemeiit name^ufferSize 0 type=^:mteg©r" minOccurs=^r> 
<xs:element name= M FrameRate tt type="xs:iiiteger a minOccuxs^'^ 
</xs:sequence> 
</xs:complexType> 
</xs:element> 
</xa:flequence> 
</xs:complexType> 
<fra:element> 
</xfi:68quence> 
</xs!ComplexType> 
</x6»lemerit> 
</xfi:schcma> 



AnVANTACTig QE T^TTC INVENTION 

Amultimedia framework built with the defined mechanism is able to adapt to 
different formats of content across different terminals and networks, which 
will be used in content retrieval, content delivery, ^deo-on-Demand, digital 
library service, etc. 

A t ermin al built with the defined structured DIA descriptions is able to access, 
retrieve, and consume content in different formats, and it is able to use in 
different applications and different aetwork conditions to expand its 
usefulness. 
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K H with the defined structured DIA descriptions is 
An adaptation gateway built wun > ^ its DIA descriptions, to 

j „, nrj>ss the input content witn its 



used in the supported terminals. 



, t%ta aescrfotions is able to select 
u 1* ™th the denned structured DIA aescnpuo 
Aserver bunt wxth the o t ^ ^ into another format, to match 

adaptation tools to convert content from one ~ ^ ^ rf 

wth the xecpnred format by a terminal, so that 



terminals to expand to business scale. 




^^^^-^Z^Oue-^V Content Delivery to Users 
Kgure 1 shows the Prior Art 1- One way 

MPEG-21 DIAParser. DIA Descriptions for Each Layer to 

Figure 4 shows Hierarchy DIA Descnp 

Describe a Media Resource. Terminal Description 

Figures 5A and 5B show the Architecture of Thrmin 

XML Schema. Resource and a 

Figure 6 shows DIA Descriptions for a Medi 

TtomnaL v mustration of an Adaptation Gateway/Terminal from 

Figure 7 shows Illustration an DIA 
form at with its DIA Descriptions to another format wi* 



one 
descriptions. 
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Figure 8 shows Illustration of MPEG-21 Iferminal with DIA 
Description used in one-way Application. 

Figure 9 shows Illustration of MPEG-21 Terminal with DIA 
Description used in Interactive two-way Application. 

* 

Figure 10 shows Real-Time Adaptation Framework for Streaming 

Content Delivery. 

Figure 11 shows a Generic Adaptation Framework to a Tterminal with 
Different Network Condition and User Preference. 
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Apparatus of Universal Multimedia Framework Tterminal with Content 
Adaptation is provided. The apparatus includes the following steps of: 
Braiding a terminal with content decoding tools that is compliant to certain 
standard; Describing the said terminal using DIA (Digital Item Adaptation) 
Descriptions; Attaching the said DIA Descriptions to the said te rminal ; 
Sending and submitting the said DIA Descriptions to a server for retrieving a 
piece of content; where said server is parsing and processing the said DIA 
Descriptions; and Selecting the content which is in the matched format with 
the said DIA Description submitted by the said terminal; and Delivering the 
said content to the said terminal. 
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2 0 ffi3£4$2 0 0 3 — 3 0 4 1 5 3 4 
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Butter- xmmvj x ^^xsc^i : iiati^ 

[0 0 6 5] 

" A-K9xr • r*5-j (*9-«B) , ff^hAA 

©W^AA) , r V7 K^-j (TW^A • V7 h • iBZTf K 

[0 0 6 6] 
[0 0 6 7] 

ISf, OS, 9. 0, 1 2 3 4 5 6 7 8, 

[0 0 6 8] 

tf, SunJREl. 2, 
[0 0 6 9] 

77-A"?i7:^>K £ttf> f^W * (D&l/Kji • yy bVxTtfmU 

[0 0 7 0] 
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[0 0 7 1]. 
[0 0 7 2] 

i©*^^-rA©iflffllBxS«, r^^n-^j £#t,3I-t5 3£, Ix.ll ftS# 

£<fctf rg/ftj b£-£A,-?v^„ mpeg-2 1 v;i/x* 

5 s -f r • 7l/-AE>-*K:#l,T, ffilS'^fAWtt riPMPj tfftlfrSfts 

^£T?ft£„ IPMPi/XfiSIlt -ttl&Oy-^/ (Tool) ID6J:ff 
RDD/RELOU-/K- PMP_To o 1 s 

[0 0 7 3] 

3S*^-fftf£l8l±. 3>f>V • ^ (*-• r-f#, fc?x>J\ lift/ ^9 7 
x*Xh) £<i:tf:g-if#{fc#-f 7 MPEG, ITU) {C«k5 

[0 0 7 4] 

* fe , if xtf & SB J* + * fc » K:B# a ti S Bf IB Jfc r W 5 1 A * fc tt / t 5 ^ - > *i« 

[0 0 7 5] 

MPEG-nlfxrt-ffi-ffl^tf-Vy MC*f7*<fc3£, MPEGltJft, 
MPEG2lfft, MPEG4tTx#, * LT£ fcMP E G 4 AVC (7 K/i 
Ifx^fiP^fb) #MPEGlff ; ^-tfb7^-Vy hfCUb 

[0 0 7 6] 
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(Simple) • 7nyTjjitfV ; r*ft J %tt.izMLX7j%Zh-c^&* 

[0 0 7 7] 

•e©h>y^{C«, HflHM'X: W/H (0ifcJ:tfiI3) , «R9-f>K 

Jf^.g>^< nTfg&T-f fAT'SS ^i?n-^/4. 9{C^$tlS, DIA 

[0 0 7 8] 

rit', hf-r^tt, CCIR601 4:2:2, • ziy#-*y h 

[0 0 7 9] 

tfxtf • 7*-7y Mi, Dv^^-ejgv^tisDv (x^^-^ 

5 s * (Digital Video)) 7#-vy K DVCPR0-25, D 
VCPRO-50, DVPRO-HD&^tJDVxxxtAA-tS. 3*ie>tt 

[0 0 8 0] 

H. 2 6x«U H. 2 6 1 fcitfH. 2 6 3 T'H&Stl, ^OxUt^^tSS 
[0 0 8 1] 

M-JPEG&, =E-i/3>JPEG^5. 
[0 0 8 2] 

WMVI1 PC©1ftlsn?JK<Mv>&ft*9^>K«7 • - bTrtf (Wi 

ndow Media Video) t'SS, 
[0 0 8 3] 
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VTJV • Ifx* (Real Video) It V7)l • *y h t7 — ^ (Re a 
1 Network) (D^&lZfS^tDftZfflCDZJ^nVTJt • :7*-Vy hT* 

[0 0 8 4] 

EGHt 2(Di^MPEG-nt-f^, MP 3, MP E G 2 — A AC 
, MPEG4-AAC, fcitfG. 721/2, G. 7 2 3. G. 7 2 6, G. 
7 2 9^©±o&GS/U-X££^--r&i&gtf&.5o ®&£<fctf?77 -f y ? 
JPEG, JPEG-2 0 0 0, GIF, TIFF, XBM, PICT, 

[0 0 8 5] 
[0 0 8 6] 

=E^n-;V6. ltii, DIAfBxStt, ^x-f 7 • U V-XfcfB&-t*fc*MC 
•;*h3*l, ^^1-^6. 2T-&, DIAfB^tt, *;i^*5*-f 7$g5fc&fBizS 

i-*fc«?>icy* i>£*i*. 

[0 0 8 7] 

SBfc*3F -frftflBB S:IBM-r -5 Z. t fCfc oTHl® D I A|Bifc#*CS#3 ft*. 
[0 0 8 8] 

^fcg^^fts. 

[0 0 8 9] 

®6fr!b, =e^rL-;i/6. Ifc«fctf6. 2©-O077f-V«y b tt-3R*1\ 
fro, *-r-f7- UV-*C&LTWC:2:/^:/y#«*T*ftM^S*J:3fc* 
* fc#> * £ v r £ fr T*& £ . 

[0 0 9 0] 
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#-fbl/W^fC*rtT, MPEG-2 AAGtt MPEG-4 AACKlh^^X 
froMPEG-2 fcf-r:tMP@ML (±^077^^*^ 
Sl/KA/) li, l/^(Level) l^iOtA-^a^ (Version) 1 
£WfSMPEG-4 ^ft^»^-7*n7r-ffl/ (Simple Pro 
file) (Chv>^3-KS4l-5. ^7>xA^-tfbl/-<-^ (Sy s t em C 
oding Layer) KMLT, MPEG-2 h^yztf- h • i/7.-rh ( 
Transport System) II MP 4 7r^f Jl/ • 7#-Vy MCI2SI 
Stlfro h^>^3- K£*l£. 2iffl<DDI AfB^tCfeVN-C. r»W5^- 

^•53i:^e>> M P E G — 2 tf-r^*^ S>, MPEG — 4 l^ft7*-79 h'S© 
[0 0 9 1] 

±»©jSHSS:iigitSfei!>K:, ®£y-h7x-f#07Kj*£tiT^6. 
[0 0 9 2] 

®7{C^-rJ:e)lC, =Ei?a^7. 1 T'tt, h^x-f ©D I A/t-t 

, fmi>tz&mts =E^a-;i/7. 2T*^*tCJ:oT^$tlfe^©DI AIB 

*-7f h^MLT^4x-?tl^i?rL-;i/7. 3, 7. 4£±tf7. 5T*gfrS*t 
5. 

[0 0 9 3] 
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<k xfr -j y 4- - h >tcis b t# irr s 0 

[0 0 9 4] 
[0 0 9 5] 

H567£H©-oi:LT, -Jl2fi5^yny ^®S:0 8(c^-r. -?-©D I AfSijE?: 

ftSMPEG- 2 lJB* { E2?a-^8. 1 tt, ® 6 ©^ *?:a. -71/ 6 . 2 JC^t" 
fig*^SS^F#-fb7*-V»y b£fB&t5DI Afaft©ffl 3>f>9l 
#*, -9— -rtCSoTV**. *- X\t> **j3.-n>8. 2T*gttIRokD I AfB 
Jft&flBIU *>-3 ! E^a-^8. 3 fg^Stlfen^-r^y ICftbTH^bfe^f 

V!r-i/ay<D%$X'ib&. 
[0 0 9 6] 

^>*7^f-f^- r^ , y^-^3>{ct3v>T©g!f©n^pJS:, @9ic^-r 

. ^i;rL-;i/9. l©«*tt, (1) ££V>TD I D/RE L/RDD/I PM 

p/d i A-efB&sftST 2 ^*^ • fcann-r*. -9— r ^ 

[0 0 9 7] 

■9— /t^3g5ft#ffi&||!»-rs-0©^^#^t5. a-if*^ -J.. ®9K: 

^1- (3) cfc^T, a.-- 9*K:»RS*i;fc. r*5MMtj fc»Rbfc*£ictt, m 
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[0 0 9 8] 

■ 

♦ 

[0 0 9 9] 

* 

|3M (Changeable Descriptions) T*&£. D I Affijjfitt. ^ I- 9 

[0 10 0] 

[0 10 1] 
[0 10 2] 
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*f-t6^HJU»'T, Qof (tf ©fcJM^ft^fr. 3fte>©£T 
[0 10 3] 

•9— /tlC7<f-K/t**S*v*. ■etifCiy, A«-e©J:3fc1t$8ft&J8b 
T, ^©.fc^fcg^©*^ 7'J y-*#Sg5fc{CBBft;3*iT, jSSJ&bfy hU- 

[0 10 4] 

Hi otc^i-jcoic. DiA^-t, *&&y-;K feW^r-'Jy-^ 

^^§=6^-^10. lKI, MP E G- 2 1 7 • t-A^g 

MPEG-2 ljg^tt, =EJ?a-M0. 5 ODD I ABiB&ASfcff'J 
t^a-JHO. 2T?wS*lTfi.U, tya-^l 0. 3 ©* >y h «7-*&#33 
J:tf:L-if 1 0. 4©n— !f • 77l/y7JC/SDT, D I AiBj£&£/&-f£ 

o 

[0 10 5] 

x e> ti s r << t u tfi ft t? & s * ft m -t m t b x £ *i t v> s . 

[0 10 6] 

ofcD I AfBMft&SU fya-;H0. 8 ©Sg£y-;i/ • J? #j >#&0> 

ftfeil^fc*? hC-*&#;S3J:tfn.-if • 7U 7 r 1/ -£UT 

So 
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[0 10 7] 

--j«ttJWl£7l/-A»7-*«:Hl llc.iaVr. 01 ltt, HRjestifeH^ftlB 

[0 10 8] 

MP EG- 2 1 7^jlf-f7-D-;^, DIA^-tS^tHya- 
/l/l 1. 1 fCast. HftSja-^y-^tt, *- /1«f7?^9^--f > • 

[0 10 9] 

tJ^a-^l 1. 6C-t®tt*fctt#£J:tfffl3tt*&«i* , t5fc»0D I A 
flBft, jfttflCt^a-^l 1. 5K*9 MJ-^fiitfa-? ■ 77 U 

2KMPEG-2 l#5-f7>h3§;fi£^-f. 
[0 110] 

[0 111] 

^^fSfetotC^^a.-;!/! 1. 5C*|R©*y h 9- <fctf3.-1f • 

5. 

[0 112] 

a -if • ^y 7r i/>^&#5fc»fc^i>'rL-;i/i i. i oci-f • >9 

n-;i/l 1. 1 1 ®aia*^*»&#*it*i t T?S> ^on-if • >^7i- 

x&^b*ca.-if{cj;ot#^.e>*iS3i:%*fenrig-e&5. 
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[0113] 
[0 114] 

i. ^fc^bfc^x-f r • 'J y-xtt. -9— ice* A^o-etitt, s^(c 

[0115] ' 
<?xml version="1.0" encoding="UTF-8"?> 

<!— edited with XML Spy v4.3 U (http://www.xmlspy.coiB) by Huang Zhongya 
ng (Panasonic Singapore Laboratories Pte Ltd) — > 

<xs: schema xmlns:xs="http: //www. w3.org/2001/XMLSchema" elementFormDef aul 
t=" qua 1 i f i ed" at tr i buteFor mDef aul t="unqua i i f ied" > 
<xs: element name^TERMINAL") 
<xs: annotation) 

<xs: documentation) It give the description of terminal capabil ities</x 
s: documentation) 
</xs: annotation) 
<xs:complexType> 
<xs: sequence maxOccurs="unbounded"> 
<xs:element name= ,f General" minOccurs="0 w > 
<xs:complexType> 
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* 

<xs: sequence maxOccurs="unbounded"> 
<xs:element name^Devicejrype" minOccurs=°O n > 
<xs:simpleType> 
<xs:restriction base= w xs:string"> 
<xs: enumeration value="Decoder"/> 

<xs: enumeration value="Encoder n /> 
<xs: enumeration value= n Gateway M /> 
<xs: enumeration value= w Router w /> 
<xs: enumeration value= w Camera ,, /> 
</xs:restriction> 
</xs:simpleType> 
</xs:element> 

<xs:element name= w Device_Class w minOccurs= M 0 n > 
<xs:simpleType> 
<xs: restr i ct i on base= M xs : str ing" > 
<xs: enumeration value="PC'7> 
<xs: enumeration value= M PDA"/> 
<xs: enumeration value="STB w /> 
<xs: enumerat ion va lue="Pr inter" /> 
<xs : enumerat i on va lue="Mob i lePhone"/> 
<xs: enumerat ion value= ww /> 
</xs: restriction) 
</xs:simpleType> 
</xs:element> 

<xs:element name="Vendor" type="xs: string" minOccurs="0"/> 
<xs: element narae="Model" type=^"xs: string" min0ccurs="0'7> 
</xs:sequence> 
</xs:complexType> 
</xs:element> 
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<xs:element name=" Hardware" minOccurs="0"> 
<xs:complexType> 
<xs: sequence maxOccurs="unbounded"> 
<xs: element nane="CPU° minOccurs="0"> 
<xs:conplexType> 

<xs:attribute name="Vendor" type="xs:string" use="optional"/> 
<xs:attribute name="Moder type="xs: string" use="required"/> 
<xs:attribute name="Speed" type="xs: integer" use="required"/> 
</xs : comp 1 exType> 
</xs:element> 

■ * 

<xs: element name="Memory" minOccurs="0"> 
<xs:complexType> 

<xs:attribute narae="Vendor" type="xs: string" use="optionar'/> 
<xs: attribute name="ModeI" type="xs: string" use="required"/> 
<xs:attribute name="Size" type="xs: integer" use="required"/> 
</xs: complexType> 
</xs:element> 

<xs: element name=" Speaker" minOccurs="0"> 
<xs:complexType> 

<xs:attribute name="Vendor" type="xs: string" use="optional"/> 
<xs: attribute narae="Type" type="xs: string" use="required"/> 
</xs:complexType> 
</xs:element> 

<xs: element name="Keyboard" minOccurs="0"> 
<xs:complexType> 

<xs:attribute name="Vendor" type="xs: string" use="optionar7> 
<xs:attribute name="Type" type="xs: string" use="required'7> 
</xs:complexType> 
</xs: element) 
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<xs: element name=" Screen" ninOccurs="0"> 
<xs:complexType> 

<xs: sequence maxOccurs="unbounded"> 
<xs: element name="Size"> 
<xs : coup 1 exType> 

<xs:attribute name="horizontal" type="xs: integer" use="requi 

red"/> 

<xs:attribute name="vertical" type="xs: integer" use="require 

d"/> 

</xs : comp 1 exType> 
</xs:element> 

<xs: element name="SizeChar" minOccurs="0"> 
<xs:complexType> 

<xs:attribute name="horizontal" type="xs: integer" use="requi 

red"/> 

<xs:attribute name=" vertical" type="xs: integer" use="require 

d"/> 

</xs:complexType> 
</xs:element> 

<xs:element name="BitPerPixel" type="xs: integer" minOccurs="0" 

/> 

<xs:element name="PointingResolution" type="xs: string" minOccu 

rs="0"/> 

</xs: sequence) 
</xs : comp 1 exType> 
</xs:element> 

<xs: element name=" Support" minOccurs="0"> 
<xs:complexType> 
<xs: sequence minOccurs="0" maxOccurs=" unbounded") 

♦ 
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<xs: element name="Color" minOccurs=°0"> 

* 

<xs:complexType> 

<xs:attribute name="Capability" type="xs: boo lean" use="requi 

red7> 

</xs:complexType> 
</xs: element) 

<xs:element name=" Text Input" minOccurs="O w > • 
<xs:complexType> 

<xs:attribute name="Capability" type="xs: boo lean" use="requi 

red7> 

</xs:complexType> 
</xs:element> 

<xs:element name="lmagelnput" minOccurs="0 M > 
<xs:complexType> 
<xs:attribute name="Capability" type="xs: boolean" use="requi 

red"/> 

</xs:complexType> 
</xs:e!ement> 

<xs:element name="VoiceInput" minOccurs="0"> 
<xs:complexType> 

<xs:attribute name="Capabi!ity M type="xs:boolean" use="requi 

red"/> 

</xs : coup 1 exType> 
</xs:etement> 

<xs: element name="Sof tKey" minOccurs="0 ,, > 
<xs:complexType> 

<xs:attribute name="Capability" type= n xs:boolean" use="requi 

red"/> 

</xs:comp!exType> 

* 
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</xs:element> 

<xs:element name="SoundOutput" minOccurs^O") 
<xs:complexType> 

<xs: attribute name^Capability" type="xs: boo lean" use="requi 



</xs : comp 1 exType> 
</xs: element > 
</xs:sequence> 
</xs:complexType> 
</xs:element> 

<xs: element name= w AssitHardware n minOccurs="0 M > 
<xs:complexType> 

<xs: sequence minOccurs= w O rt maxOccurs= n unbounded"> 
<xs: element name= w SmartCard" minOccurs^'O") 
<xs:complexType> 

<xs: attribute name="Vendor tt type= tt xs: string" use="optional'7 



<xs:attribute name^Model" type= w xs: string" use= M required'7> 
< /xs : comp 1 exType> 
</xs:element> 

<xs: element name^'HardKey" minOccurs= ,, 0 ,, > 
<xs:complexType> 

<xs:attribute name=" type" type="xs:string" use= M required tt /> 
</xs:complexType> 
</xs: element) 
</xs: sequence) 
</xs:complexType> 
</xs: element) 
</xs: sequence) 



red7> 



> 



3 5 



ffiSE# 2003-3041534 



#2 00 2-127160 

</xs : comp 1 exType> 
</xs: element) 

<xs: element name=" Software" minOccurs="0"> 
<xs:complexType> 
<xs: sequence maxOccurs="unbounded"> 
<xs:eienent name="0S" minOccurs="0"> 
<xs:conplexType> 
<xs:attribute name="Vendor" type="xs: string" use="optional"/> 
<xs:attribute name="Name" type="xs: string" use="required"/> 
<xs: attribute name="Version" type="xs:f loat" use="required"/> 
<xs:attribute name="SerialNo" type="xs:nonNegativeInteger" use= 
"optional"/) 

</xs : comp 1 exType> 
</xs: element) 

<xs: element name="VM" minOccurs="0"> 

* 

<xs : comp 1 exType> 
<xs:attribute name="Vendor" type="xs: string" use="required"/> 
<xs:attribute name="Name" type="xs: string" use="required"/> 
<xs: attribute name="Version" type="xs: string" use="required"/> 

</xs: complexType) 
</xs: element) 

<xs: element name="Firmware" minOccurs="0"> 
<xs:complexType> 

<xs:attribute name="Vendor" type="xs: string" use="required'7> 
<xs:attribute name="Name" type="xs: string" use="required"/> 
<xs:attribute name=" Version" type="xs: string" use="required"/> 
</xs: complexType) 
</xs: element) 

<xs: element name="Support" minOccurs="0"> 
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<xs:complexType> 
<xs: sequence minOccurs="0" maxOccurs=" unbounded" > 
<xs: element name=°Download n minOccurs="0"> 
<xs:complexType> 

<xs:attribute name="Capability" type=°xs: boo lean" use="requi 

red w /> 

</xs : comp 1 exType) 
</xs: element > 

<xs:element name="Browser" minOccurs="0"> 
<xs:complexType> 

<xs: attribute name="Name" type="xs: string" use="required"/> 
<xs:attribute name=" Vers ion" type="xs:f loat" use=" required"/ 

> 

</xs: complexType> 
</xs: element) 
</xs: sequence) 
</xs : comp 1 exType> 
</xs: element) • 
</xs: sequence) 
</xs : comp 1 exType) 
</xs: element) 

<xs: element name=" System" minOccurs="0"> 
<xs:complexType> 

<xs: sequence maxOccurs="unbounded"> 
<xs: element name="General" minOccurs="0") 
<xs:complexType> 
<xs: sequence minOccurs="0"> 
<xs: element name="Modules" minOccurs="0"> 
<xs:complexType> 
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<xs:attribute name="ModuleID n type="xs:unsignedlnt" use="req 

uired w /> 

<xs: attribute name="Processing* type^xszboolean" use="requi 

red w /> 

</xs: complexType> 
</xs:element> 

<xs: element name=" Components" minOccurs= B 0 M > 
<xs:complexType> 

<xsrattribute name="ConsponentID" type="xs:unsignedlnt" use=" 

required"/) 

<xs:attribute name= w Interconnect" type="xs: boo lean" use="req 

uired7> 

</xs : comp 1 exType> 
</xs: element) 

<xs: element name="Conf igration" minOccurs= n O" > 
<xs : comp I exType> 

<xs:attribute name="Option" type="xs:boolean w use="required" 

/> 

</xs:complexType> 
</xs:element> 
</xs:sequence> 
</xs : comp 1 exType> 
</xs:element> 

<xs: element name^'IPM?" minOccurs="0"> 
<xs:complexType> 
<xs: sequence minOccurs^'O") 

<xs:element name="ResidingTools" minOccurs="0 n maxOccurs= M unbo 

unded"> 

<xs:complexType> 
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<xs:attribute nane="ToolID n type="xs:unsignedInt n /> 
</xs : comp 1 exType> 
</xs: element > 

<xs: element name= tt RDDREL n minOccurs="O rt > 
<xs:complexType> 

<xs:attribute naae="Capability* type="xs:boolean" use="requi 

red n /> 

</xs : camp 1 exType> 
</xs:element> 
</xs:sequence> 
</xs:complexType> 

i 

</xs:element> 
</xs: sequence) 
< /xs : comp 1 exType> 
</xs:element> 

<xs: element name="CodingCapabi 1 i ty" minOccurs="0"> 
<xs:complexType> 
<xs: sequence maxOccurs="unbounded"> 
<xs: element name=" Audio" minOccurs="0"> 
<xs:coraplexType> 
<xs:choice> 

<xs: element name="MPEG"> 
<xs:complexType> 

<xs: sequence maxOccurs=" unbounded") 
<xs: element name="MPEG-l" minOccurs="0"> 
<xs : comp 1 exType> 
<xs: sequence) 
<xs: element name="Layer"> 
<xs:simpleType> 
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<xs: restrict ion base= w xs:string w > 
<xs: enumeration value= n r/> 
<xs: enumeration value= w ir/> 
<xs: enumeration value= l, IH n /> 
</xs:restriction> 
</xs:simpleType> 
</xs:element> 
</xs:sequence> 
</xs:complexType> . 
</xs:element> 

<xs: element name= w MPEG-2 w minOccurs= ,, 0"> 
<xs:compIexType> 
<xs:choice> 
<xs: element name="LowSampl ingRateLayer") 
<xs:simpleType> 

<xs: restr i ct i on base= w xs : str ing") 
<xs: enumeration value= M I w /> 
<xs: enumeration value="ir/> 
<xs: enumeration value= w Iir/> 
</xs: restriction) 
</xs:simpleType> 
</xs: element) 

<xs : e 1 emen t name="Backwar dCompa t ib 1 eMCLayer " > 
<xs:simpleType> 
<xs : r est r i ct i on base= M xs : str ing" > 
<xs: enumeration value= M I tt /> 
<xs: enumeration value="II"/> 
<xs: enumeration value="Iir/> 
</xs: restriction) 
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</xs:simpleType> 
</xs:element> 
<xs: element name^AAO 

<xs:simpleType> 

<xs: restrict ion base= n xs:string n > 
<xs: enumeration value="LowComplexity n /> 
<xs: enumeration value="MainProf ile"/> 
<xs: enumeration value= w SamplingRateScaleableProf i le**/ 

<xs: enumeration value= tt "/> 
</xs:restriction> 
</xs:simpleType> 
</xs: element > 
</xs: choice) 
< /xs : comp 1 exType> 
</xs:element> 

<xs: element name= B MPEG-4" minOccurs="(r> 
<xs:complexType> 
<xs:choice> 
<xs: e 1 ement name= M Synthet icProf i le" > 
<xs:sinpleType> 
<xs: restrict ion base="xs: string") 
<xs : enumer a t i on va 1 ue="Leve 1 1 " /> 
<xs : enumer at i on va 1 ue="Leve 1 2" /> 
<xs : enumer at i on va 1 ue=" Leve 1 3" /> 
</xs: restriction) 
</xs:simpleType> 
</xs: element) 

<xs : e 1 emen t name= " SpeechPr of i le"> 
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<xs:simpleType> 

<xs : res tr i c t i on base=" xs : s tr i ng" > 
<xs: enumeration value= ,, LeveIl'7> 
<xs remuneration va!ue= w Level2 ,, /> 
</xs:restriction> 
</xs:simpleType> 
</xs: element) 

<xs : e 1 ement name=" Sea 1 ab 1 ePr of i 1 e w > 
<xs:simpleType> 

<xs : r es tr i c t i on base="xs : str i ng" > 
<xs remuneration value= w Levell w /> 
<xs remuneration value="Level2"/> 
<xs: enumeration value="Level3'7> 
<xs : enumer a t i on value="Leve 14" /> 
</xs: restriction) 
</xs:sirapleType> 
</xs: element) 

<xs : e 1 emen t name="Ma i nPr of i 1 e" > 
<xs:simpleType> 

<xs: restr ict ion base= M xs: str ing") 
<xs : enumer at i on va lue="Leve 1 1" /> 
<xs : enumer at i on va 1 ue=" Leve 1 2" /> 
<xs : enumer at i on va 1 ue="Leve 1 3" /> 
<xs : enumer at i on va 1 ue=" Leve 14"/) 
</xs:restriction> 
</xs:simpleType> 
</xs:element> 

<xs: element name="H ighQul i tyProf i le"> 
<xs:simpleType> 



#2 002 — 127160 

<xs : res t r i ct i on base="xs : str ing" > 
<xs: enumeration value= ,, Levell w /> 
<xs: enumeration value="Level2 n /> 
<xs: enumeration value^LevelSV^ 
<xs: enumeration value^Level^/) 
<xs: enumeration value= w Level5"/> 
<xs: enumeration value= w Level6 B /> 
<xs: enumeration value= M Level7"/> 
<xs : enumer a t i on va iue="Leve 1 8" /> 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 

<xs : e 1 emen t name= w LowDe 1 ayPr of i 1 e" > 
<xs:simpleType> 

<xs : r es tr i ct i on • base="xs : str ing" > 
<xs : enumer at ion va 1 ue=" Le ve 1 1"/> 
<xs: enumeration value= n Level2"/> 
<xs : enumer at i on. va lue= M Leve 13" /> 
<xs: enumeration value="Level4"/> 
<xs: enumeration value= ,, Level5 , 7> 
<xs : enumer at i on va lue="Leve 16"/> 
<xs : enumer a t i on va 1 ue=" Leve l7 M /> 
<xs : enumer at i on va lue=" Leve 18"/> 

</xs: restriction) 
</xs:simpleType> 
</xs:element> 

<xs : e i ement name="Natur a lPr of i 1 e"> 
<xs:simpleType> 

<xs :restriction base= M xs:stri ng" > 
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<xs:enumeration value= w Leve!l"/> 
<xs: enumeration value= ,, Level2"/> 
<xs remuneration value="Level3 ,, /> 
<xs remuneration vaJue="Level4 ,, /> 
</xs:restriction> 
</xs:simpieType> 
</xs: element) 

<xs:element name=°Mobi lelnternetworkingProf i le"> 
<xs:simpieType> 

<xs : res t r i ct i on base=" xs : st r i ng B > 
<xs: enumeration value="Levell w /> 
<xs: enumeration value="Levei2 , 7> 
<xs: enumeration value= M Level3 w /> 
<xs: enumeration value="Level4"/> 
<xs: enumeration value="Level5"/> 
<xs: enumeration value="Leve!6 w /> 
</xs:restriction> 
</xs:simpleType> 
</xs:element> 
</xs: choice) 
</xs : comp 1 exType> 
</xs: element) 
</xs: sequence) 
</xs:complexType> 
</xs: element) 
<xs:eiement name=" ITU-T") 
<xs:simpleType> 

<xs: restriction base="xs: string") 
<xs:enumeration value="G.723' , /> 
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» 

<xs : enumer at i on va 1 ue="G . 723 . 1" /> 
<xs: enumeration value="G.726"/> 

<xs: enumeration va!ue="G.728 w /> 

f 

<xs: enumeration value= w G.729 M /> 
</xs:restriction> 
</xs:simpleType> 
</xs:element> 

<xs: element name="OtherCoding w > 
<xs:simpleType> 

<xs: restriction base="xs:string D > 

<xs: enumeration value="AC3 ,, /> 

<xs: enumeration value= w DTS w /> 

<xs: enumeration value="AMR w /> 

<xs:enumeration value= M LPCM"/> 

<xs: enumeration va lue=" ATRAC "/> 

<xs: enumeration value= w ATRAC2"/> 

<xs : enumer at i on va lue=" ATRAC3" /> 
</xs:restriction> 
</xs:simpleType> 

> 

</xs: element) 
</xs:choice> 
</xs : comp 1 exType) 
</xs: element) 

<xs: element name="Video w minOccurs="0"> 
<xs:complexType> 
<xs: choice) 

<xs: element narae= ,, MPEG r, > 
<xs:compiexType> 

<xs: sequence maxOccurs=" unbounded") 
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<xs:element name= n MPEG-l w type="xs: boo lean" minOccurs= tt 0 w /> 
<xs: element name="HPEG-2" minOccurs="0 ,, > 
<xs:complexType> 
<xs:choice> 

<xs : e 1 emen t name= " S i mp I eProf i 1 e w > 
<xs:simpleType> 

<xs:restriction base="xs:string w > 

<xs : enumer a t i on va I ue=" Ma i nLe ve 1 " /> 
</xs:restriction> 
</xs:simpleType> 
</xs:element> 

<xs: element name="MainProf i le"> 
<xs:simpleType> 

<xs: restrict ion base= n xs: string") 
<xs : enumer at i on va lue="LowLeve 1 " /> 
<xs : enumer at i on va 1 ue="Ma i nLeve 1 " /> 
<xs: enumeration value="Highl440Lever/> 

<xs: enumeration vaiue="Hightever/> 
</xs: restriction 
</xs:simpleType> 
</xs: element) 

<xs : e 1 ement name="SNRSca 1 ab 1 eProf i 1 e" > 
<xs:simpleType> 

<xs: restriction base="xs: string") 
<xs : enumer at i on va 1 ue="LowLeve 1 "/> 
<xs : enum.er at i on va 1 ue="Ma i nLeve P /> 
</xs:restriction> 
</xs:simpleType> 
</xs: element) 
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<xs: element name="SpatialScalableProf ile") 
<xs:simpleType> 
<xs:restriction base="xs:string w > 
<xs: enumeration va lue=" Ha i nLeve r/> 
<xs : enumer at i on va 1 ue=" H i ghl440Leve 1 n /> 
<xs : enumera t i on va lue=" H i ghLeve 1 " /> 
</xs: restriction) 
</xs:simpleType> 
</xs:element> 

<xs: element name="HighProf ile w > 
<xs:simpleType> 

<xs:restriction base="xs: string") 
<xs : enumer at i on va 1 ue= n Ma i nLeve 1 n /> 
<xs : enumer a t i on va 1 ue= " H i ghl 440Leve 1 " /> 
<xs : enumer a t i on v a 1 ue= " H i ghLe v e 1" / > 
</xs: restriction) 
</xs:simpleType> 
</xs: element) 

<xs : e 1 emen t name=" Mu 1 1 i v i ewPr of i 1 e" > 
<xs:simpleType> 

<xs: restrict ion base="xs:string"> 
<xs : enumer a t i on va 1 ue=" Ma i nLeve 1"/ > 
</xs:restriction> 
</xs:simpleType> 
</xs: element) 

<xs:element name="V422Prof ile") 
<xs:simpleType> 

<xs : r estr i c t i on base="xs : str ing") 
<xs : enumer at i on va 1 ue= " Ma i nLeve 1 "/> 
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</xs:restriction> 



</xs:simpleType> 



</xS:element> 
</xs:choice> 
</xs : comp 1 exType> 
</xs:element> 

<xs: element name="MPEG-4" minOccurs="0 M > 
<xs:complexType> 
<xs: choice) 

<xs : e i emen t n ame= w S i mp I ePr of i 1 e" > 
<xs:simpleType> 

<xs : restr i ct i on base="xs : s tr ing" > 
<xs: enumeration value= w LevelO ,, /> 
<xs: enumeration value= w Levell n /> 
<xs: enumeration value= w Level2 w /> 
<xs: enumeration va 1 ue= M Level 3 w /> 
</xs:restriction> 
</xs:simpleType> 
</xs:element> 

* 

<xs : e 1 emen t name= n Sea 1 ab 1 ePr of i 1 e" > 
<xs:simpleType> 

<xs : r es tr i c t i on base="xs : s t r i ng w > 
<xs : enumer a t i on va 1 ue=" Leve 1 l w /> 
<xs : enumer a t i on va 1 ue= " Level 2" /> 
</xs:restriction> 
</xs:simpleType> 
</xs:element> 

<xs : e lement name=" AdvancedS impleProf i le"> 
<xs:simpleType> 
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<xs : restr i ct i on base= tt xs: str ing" > 
<xs: enumeration value^LevelO^A 
<xs remuneration vaiue= n Levell"/> 
<xs: enumeration value="Level2 ,, /> 
<xs: enumeration value="LeveI3"/> 
<xs: enumeration value= ,, Level4 ,, /> 
<xs: enumeration value= w Level 5"/> 

</xs:restriction> 
</xs:simpleType> 
</xs: element > 

<xs:element name= w CoreProf i le"> 
<xs:simpleType> 

<xs: restr iction base="xs: str i«g"> 
<xs : enumera t i on va lue=" Leve 1 1" /> 
<xs : enumera t i on va 1 ue=" Leve 12"/> 

* 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 

<xs : e i ement name="Cor eSca 1 abl ePr of i 1 e"> 
<xs:simpleType> 

<xs : restr i ct i on base= M xs : str ing" > 
<xs: enumeration value= w Levell"/> 
<xs: enumeration value= w Level2 ,, /> 
<xs: enumeration value="Level3 w /> 
</xs: restr iction> 
</xs:simpleType> 
</xs: element) 

<xs: el ement name="AdvancedCoreProf i le"> 
<xs:simpieType> 
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<xs : r es tr i ct i on base=" xs : str i ng n > 
<xs remuneration value= w Levell*7> 
<xs: enumeration value= w Level2 w /> 
</xs:restriction> 
</xs:simpleType> 
</xs:element> 

<xs: element name= w MainProf ile w > 

■ 

<xs:simpleType> - 

<xs : r est r i ct i on base= tt xs : str ing" > 
<xs: enumeration value= w Level2 w /> 
<xs : enumerat i on va 1 ue="Leve 13" /> 
<xs: enumeration value= n Level4 w /> 
</xs: restrict ion> 
</xs:simpleType> 
</xs:element> 

<xs: element narae="NbitProf ile w > 
<xs:simpleType> 

<xs: restriction base= M xs:string"> 
<xs: enumeration value="Level2"/> 
</xs:restriction> 
</xs:simpleType> 
</xs:element> 

<xs: element name="AdvancedRealTimeSimpleProf ile"> 
<xs:simpleType> 

<xs: restriction base="xs:string tt > 
<xs: enumerat ion value="Levell"/> 
<xs : enumerat i on va 1 ue=" Leve 1 2"/> 
<xs: enumerat ion value= M Level3"/> 
<xs: enumerat ion value="Level4"/> 
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</xs: restrict ion) 
</xs:simpleType> 
</xs: element) 

<xs : e 1 ement name=" AdvancedCod i ngEf f i c i encyPr of i 1 e" > 
<xs:sinpleType> 

<xs : restr i ct i on base= M xs : str ing") 
<xs: enumeration value= w Levell I, /> 
<xs: enumeration value= w Level2 ,, /> 
<xs: enumeration value= w Level3 ,, /> 
<xs: enumeration vaIue="Level4"/> 
</xs:restriction> 
</xs:simpleType> 
</xs: element) 

<xs : e 1 ement narae="S imp 1 eStudi oProf i I e" > 
<xs:simpleType) 

<xs: restr iction base="xs: string") 
<xs : enumer at ion va 1 ue="Levell" /> 
<xs: enumeration value="Level2 n /> 
<xs: enumeration value="Level3"/> 
<xs: enumeration value="Levei4"/> 
</xs:restriction> 
</xs:simpleType> 
</xs: el ement) 

<xs : e 1 ement name="Cor eStudi oPr of i 1 e" > 
<xs:simpleType> 

<xs: restr iction base="xs: string") 
<xs : enumerat ion value="LeveU" /> 
<xs: enumeration value="Level2 w /> 
<xs : enume r a t i on va 1 ue=" Leve 13"/) 
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<xs: enumeration value= w Level4"/> 
</xs:restriction> 
</xs:sinpleType> 
</xs:element> 

<xs: element name="FGSProf ile w > 
<xs:sinpleType> 

<xs: restriction base="xs:string w > 

<xs: enumeration value= w LevelO w /> 

<xs: enumeration value= H Levell M /> 

<xs: enumeration value="Level2 n /> 

<xs: enumeration value= w Level3 ff /> 

<xs: enumeration value= n Level4 ,, /> 

<xs: enumeration value="Level5"/> 
</xs:restriction> 
</xs:simpleType> 
</xs:element> 

<xs : e 1 emen t name=" S i mp 1 eFace An i ma t i onPr of i 1 e" > 
<xs:simpleType> 

<xs: restriction base="xs:string M > 
<xs: enumeration value="Leveir7> 
<xs : enuraer a t i on va 1 ue=" Leve 1 2" /> 
</xs: restrict ion> 
</xs:simpleType> 
</xs: element) 

<xs : e 1 emen t name=" S i mp 1 eFBAPr of i 1 e" > 
<xs:simpleType> 

<xs: restrict ion base="xs:string"> 
<xs : enumer at i on va 1 ue="Leve 11 "/> 
<xs : enumer at i on va lue=" Leve 12" /> 
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</xs:restriction> 
</xs:simpleType> 
</xs: element) 

<xs:element name= B BasicAnimatedTextureProf ile") 
<xs:simpleType> 

<xs: restrict ion base^xs: string") 
<xs remuneration value= w Levell , 7> 

<xs: enumeration value= n Level2"/> 

> 

</xs:restriction> 
</xs:simpleType> 
</xs: element) 

<xs : e 1 emen t name= w Sea I ab 1 eTextur ePr of i 1 e" > 
<xs:simpleType> 

<xs:restriction base="xs: string") 
<xs: enumeration value="Leveir7> 
</xs: restriction) 
</xs:simpleType> 
</xs: element) 

<xs : e 1 emen t name=" AdvancedSca 1 ab 1 eTextur ePr of i 1 e" > 
<xs:simpleType> 

<xs : r es t r i c t i on base=" xs : st r i ng" > 
<xs : enumera t i on va 1 ue="Leve 1 1 "/> 
<xs: enumeration value="Level2"/> 
<xs: enumeration value="Level3"/> 
</xs:restriction> 
</xs:simpleType> 
</xs: element) 

<xs : e 1 emen t name=" Hybr i dPr of i 1 e" > 
<xs:simpleType> 
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<xs : rest r i c t i on base=° xs : s tr i ng" > 
<xs: enumeration value= B LeveIl°/> 
<xs: enumeration value= ,, Level2 ,, /> 
</xs:restriction> 
</xs:simpleType> 
</xs: element) 
</xs:choice> 
</xs: coop 1 exType> 
</xs:element> 
</xs:sequence> 
</xs : corap 1 exType> 
</xs:element> 
<xs: element name=" ITU JT> 
<xs:simpleType> 
<xs: restrict ion base= w xs:string"> 
<xs: enumeration value="H261"/> 
<xs: enumeration value= w H263 w /> 
</xs: restrict ion> 
</xs:simpieType> 
</xs:element> 

<xs: element name="M-JPEG"> 
<xs:simpleType> 

* 

<xs: restrict ion base="xs:string"> 

<xs: enumeration value="mjp2Prof ile w /> 
<xs : enumera t i on va lue= w m j 2sPr of i 1 e" /> 
</xs:restriction> 
</xs:simpleType> 
</xs:element> 

<xs : e 1 emen t name= " 0 1 her Cod i ng" > 





#2002-127160 



<xs:simpleType> 



<xs:restriction base= " xs : s t r i ng" > 



<xs: enumeration value= w RealVideo ,, /> 
<xs remuneration value= n BMV n /> 
<xs: enumeration value= w QuickTime w /> 
</xs:restriction> 
</xs:simp!eType> 
</xs:element> 
</xs: choice) 
</xs : comp 1 exType> 
</xs:element> 

<xs: element naae="ImageGraphics" minOcctirs= w O ,, > 
<xs:simpleType> 

<xs : restr i ct i on base="xs: str ing" > 
<xs: enumeration va!ue="JPEG ,, /> 
<xs: enumeration value="JPEG2000"/> 
<xs: enumeration value="TIFF n /> 
<xs: enumeration value="GIF w /> 
<xs: enumeration value="XBM w /> 
<xs: enumeration value="PNG"/> 
<xs: enumeration value=""/> 
</xs:restriction> 
</xs:simpleType> 
</xs:element> 

<xs: element narae="Text" minOccurs= w O M > 
<xs : comp 1 exType> 
<xs:choice> 

<xs: element name="ASCII" type= M xs:boolean"/> 
<xs: element name="Non-ASCII"> 
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/> 



/> 



<xs:simpleType> 

<xs : restr ict i on base="xs: s tr ing") 
<xs:enuneration value="HTML ,, /> 
<xs: enumer at i on val ue=" IS0-8859-r /> 
<xs: enumeration value= n Shif t_JIS7> 
</xs:restriction> 
</xs:simpleType> 
</xs: element) 
</xs: choice) 
. </xs:complexType> 
</xs: element) 

<xs: element name="Con'trolTerm" minOccurs="0"> 
<xs:complexType> 

<xs: sequence maxOccurs=" unbounded") 
<xs:element name="DisplayWinSize" minOccurs="0"> 
<xs:comp!exType> 

<xs:attribute name="Width w type="xs: integer" use="required"/ 
<xs:attribute name="Height" type="xs: integer" use="required" 

</xs:complexType> > 
</xs: element) 

<xs: element naoe= w PictureSize" minOccurs="0"> 
<xs:complexType> 

<xs:attribute name="Width" type="xs: integer" use=" required"/ 
<xs:attribute name="Height" type="xs: integer" use="required" 
</xs:complexType> 
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</xs:element> 

<xs:element name="Bitrate" type="xs: integer" minOccurs="0"/> 
<xs:element name="Buf ferSize" type="xs: integer" minOccurs="0"/ 

> 

<xs:element name="FrameRate" type="xs: integer" minOccurs="0"/> 
</xs: sequence) 
</xs:compIexType> 
</xs:element> 
</xs:sequence> 
</xs : comp 1 exType> 
</xs:element> 
</xs:sequence> 
</xs : comp 1 exType> 
</xs:element> 
</xs:schema> 

[0 116] 
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[0 117] 
[0 118] 
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[0 119] 

#'atlfe7*-Tv he-art 5 -o<D7j|--vy hfrP>jK©7#-"7 

>-r > 7 $:BB#-r 3 0T* % 5 . 

[02] m*&ffi2 -J|fc& £47®*$ If /V 3R#Rn»3 

[03] MPEG-21 D I AfBi£&fc<fctfMPEG- 2 1 D I AA— U" 

[04] ^x-f 7- UV-^&fiat*, #Mfc*hrsPIMDIA8ffi*& 

[05 A] «*ffiiSXML^*-y<D7-'¥r'^xArfea%tH'eJfe6. 
[05 B] «*B&XML**-V©7-*x***«:a* , *H , e«&S. 
[06] *x-f7 • U V-^fcJ:tFSS*K:^tSDI AMfcaVrHTf* 

[07] -£©DI AEfcfc***— 3<D7*-7» hfr*>*©DI AfB& 

[08] -T#ft7?U>T-S/s>T?J8V^*l3D I AgaxR5:^-r^MPE 
G-2 mjfcfcjRtHTf&S. 

[09] ■iy*U ) 7 ; T-{ 7"H^I^77'U^ — i/a ^l?Mv^tl€»D I AiB 
«&ft§MPEG-2 l**S:wtHTf**. 

[0io] xhU-s • ny^yvm^izMt?>'J7)Vit^Am^y 

[01 1] J*fc6*y h9-^*fffeitfa- 9 s • yj77l/>^5;ft 



5 8 



2003-3041534 



#2002-127160 



\ 



5 9 ffiE# 2003-3041534 



mm*] mm 



#2 00 2-127160 



1.1 





B2<S 


(MPEG-2 MP 


1 












MPEG-4 
S i mp I e 



[MPEG-4 
Cor o<DPD 



OK 



MPEG-2 
MP@H L0> 
DTV STB 



1.2 




1.3 



1.4 




1 



ffi!£# 2003-3041534 



4S2 0 0 2-1 2 7 1 6 0 



mz] 



r 



2.1 



(MPEG-2 MP 



2.1 



4- 






MPEG-4 
S i mp 1 e 












— ► 


4- 






MPEG-4 










Cor eCO / 




w 


PDA 







MPEG-2 
MP@HL<& 
DTV STB 


t lit* > 











WMTCOPC | 





2.2 




2.3 



2.4 



2 



ftIE$f 2 003-3041 534 



# 




#2 002-1271 60 



[S3] 



r_ 

12gLfcMPEG-2 1 T/l^-r-f T • tf— /< 



3.1 



3.2 



"9— /to<-&<0D I Affii&£ • 

assies* 



3J 



MPEG-2 1 
(D ] AtfQ*) 



«< 5$ ? • 7*'J <r-*> 3 > 



D 1 n>r^-!C^$nfcD I A 
CSESBKU fflrU gift** 



D I AmrK&Vm&Wz. 



3.5 



r 



3.11 



TCP/1 P, UDP, ATM,. . . 



>r-X2 : a5fc7^U*-*>3>l3g&$H6MPEG-2 1 
D I A/*-* 



h : RTP. H. 32X, . . . 



HW&fci'X^A&te : TS. PS, MP4. QuickTime. AVI 



fx* : HPGB1/2/4. H. 261/3, DV. DVCPR025/50/100. . . . 
T-f * : KPEG1 U-f* 2. KP3. UPEG2/4 AAC, AC3, 6. 7XX 



r 



r 



3.6 



3.7 



3.8 



3.9 



3.10 



3 



#SE#2 003-3041534 




432 00 2- 127160 



4] 




4 



fflSE#2 003-3041 5 3 4 



#2 002-127160 



[0 5 A] 




f m l Keyboard 5 




5 



ffiSE# 2003-3041534 



4# 2 0 0 2 — 127160 

[H5B] 





6 



ffi!I#2 003-3041534 



# 




#2 002-127160 



me] 



6.1 




MPEG2TS 

-*MPEG2 AAC audio 
->MPEG2 video 

->MP@ML 

©StfMX :7O4x480 
*^ry-<X:720x486 
bf-y h • L^-H :6Kbps 
L^-h :30fps 



□ >r>^/>:f <7 • UV— XfflD I ae& 

c 




63 



o i Affile £ ye^ns* h y-idis 





di asb& 







6.2 



MP4 FGc Format 

->MEEG* AAC amfio 
-»MPEG4 video 
-»Simple 

•*JLevd 1 

USr9--<X:352x288 
£;5ctMX:352x288 
e ? h • U- h :1024kbps 
• U— K :10fps 



z: 



6.4 



D I AE£-effi&$ft£4g;fc 




A fig* 











fflll#2 003-304 1534 



^2002-127160 



[07] 



7.1 



D 1 A/<-"9- 




7J 



7.4 




*T4T- UV— X 



r 7.5 



_! ! I 1 



8 



ffiSE#2 003-3041534 




IM8] 



#2 00 2-127160 



(1) 

Jg3fcfl>D I A 



8.1 



MPEG-2 1$g3fc 



c 



%2 



/«DO I A/<— 
ICcfcy. SftSEdDD I A 



(2) 



8.3 



***** 



9 



ffiiE# 2003-3041534 



#2 002—127160 



IH9] 



9.1 



1 

a) d i zmmtz 



(2) Oa-f.x 




0) r-feu^S/ 3 >j 



(4) — SfcLfc:?*— h£ 



9,2 



DID/REL^D/IP61P/DIAICj:yffi2$^MPEG-2 1 
D I £*Tf 6MPEG-2 1 TA/^y«r-<T • *J— /< 



1 0 



ffiIE#2 003-3041534 






[01 0] 



#2 00 2-127160 



*v YD- 1 ? finite— tf- ^U77U>7.S^ 




• • • 

• • • 



MPEG-2 1 



• • » • 
• • • i 



; $i&S :28kbps 



-:v: : :::o:*:-::x-:-x^. l07 * o ®a :2t» 



• ft i ft 
• « • 



• » • 
« • • • ••••■ 

• ■• * 
*•*•••••< 

• •■••••ft* 
• •- -^••» 

• *«*•••*• 

• ■•«••••■ 



• ♦■••••ft 
• *•••••• 

• ••••»»*• 



• •• ft ft 



• • 
• « • 



.*.*.* 

■ \ m 




O I A/<— * 



• • 
• ■ m * « 

■ # * * « 
« • • * • 



« • I • * * 

• * i 
• • | ■ • • 



■ * ft 
* • • 
. fft 



10.6 



• •00 



I v m 



• ft 

• ft 

• ft 

• » 

• ft 
ft ft 

ft ft 



ft ft 
ft * 



1 



10.8 



10.9 



1 



1 



• 'J V— X 



ft • * ft 4 



MP EG- 2 1 $5-<y> h*8£ 

r 



D I ASZS0)&£ 



« • • » 



• • • • • 



V. V.Vr: 103 ivjgr 10.4 



» • • • * • 



105 



• • * * 
• • • 
• • 



^ * 



3. — +f • 



• ft ft ft 



• •••»» 

> *••«*• 

• ••••» 



• • 



aj|iE#2 003-3041534 



[01 1] 



#2 00 2-127160 



U.1 



MPEG-21 
• 'J V-X£^fc) 




11.2 



■ • • • 



• • • » 



• » * * * 



» * « • * 



• • » • * 



****** 



*»••■■•»•• * 4 • ■ ■ la ■ 




1L7 



» * • * • 

t » i • ■ • 



D I A/<— if 



1 



li 



J—J. 



1 



f 11.8 



« • a 



11.9 



1 



MPEG-2 1 »^7>H gir|.v 



d i asks 



D I Affij&<D£j& 



T l I 



>r! 11J -I 



£2 



✓HIS 

r I- -' 

11.4 



f f i t A i ii i I * » i . a i i Avi 



11.11 



1.10 



ffiE#2 003-3041534 




#2 002-127160 

y h©3^7 1 > s y2:ji^'t5^-r7yi:, ^*K^<Z>=t:/-r:/y ; §:£}i'r£;*T• 
[StRB] H 3 



1 



ffiiE#2 003-3041534 



#2 00 2-127160 



ai m a js m m m 

■ 

MH# [00 0 005821] 

1. IZM^M H 1 9 9 0* 8 J! 2 8H 



i 



fflfE# 2003-3041534 



